Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj to ip-10-0-141-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-b8c9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-b8c9t to ip-10-0-131-88.ec2.internal

openshift-ingress

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt to ip-10-0-141-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gxhkr to ip-10-0-141-160.ec2.internal

openshift-ingress

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m to ip-10-0-142-230.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-74jxg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-74jxg to ip-10-0-131-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9 to ip-10-0-141-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg to ip-10-0-131-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq to ip-10-0-142-230.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6 to ip-10-0-131-88.ec2.internal

openshift-ingress

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-96a65772-openshift-default-546fc9768-l9t7w to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-904baa-openshift-default-59885b7858-c44r7 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7 to ip-10-0-142-230.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-sx8kg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sx8kg to ip-10-0-141-160.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-8r4v2

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-8r4v2 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd to ip-10-0-142-230.ec2.internal

openshift-ingress

kube-auth-proxy-746f6cf6d8-k8m7s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746f6cf6d8-k8m7s to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq to ip-10-0-142-230.ec2.internal

openshift-ingress

router-default-757957ffc-frc2z

Scheduled

Successfully assigned openshift-ingress/router-default-757957ffc-frc2z to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5 to ip-10-0-131-88.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6 to ip-10-0-142-230.ec2.internal

openshift-ingress

kube-auth-proxy-746f6cf6d8-2f9gn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746f6cf6d8-2f9gn to ip-10-0-141-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj to ip-10-0-131-88.ec2.internal

openshift-ingress

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8 to ip-10-0-131-88.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-757957ffc from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-757957ffc

FailedCreate

Error creating: pods "router-default-757957ffc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-757957ffc

FailedCreate

Error creating: pods "router-default-757957ffc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-757957ffc

SuccessfulCreate

Created pod: router-default-757957ffc-frc2z
(x6)

openshift-ingress

kubelet

router-default-757957ffc-frc2z

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-757957ffc-frc2z

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-757957ffc-frc2z

Started

Started container router

openshift-ingress

kubelet

router-default-757957ffc-frc2z

Created

Created container: router

openshift-ingress

kubelet

router-default-757957ffc-frc2z

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-757957ffc-frc2z

AddedInterface

Add eth0 [10.133.0.8/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-746f6cf6d8

FailedCreate

Error creating: pods "kube-auth-proxy-746f6cf6d8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-746f6cf6d8 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-746f6cf6d8

SuccessfulCreate

Created pod: kube-auth-proxy-746f6cf6d8-k8m7s

openshift-ingress

replicaset-controller

kube-auth-proxy-746f6cf6d8

SuccessfulCreate

Created pod: kube-auth-proxy-746f6cf6d8-2f9gn

openshift-ingress

multus

kube-auth-proxy-746f6cf6d8-k8m7s

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-2f9gn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-k8m7s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-746f6cf6d8-2f9gn

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-sx8kg

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-sx8kg

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-k8m7s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.74s (2.74s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-k8m7s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-k8m7s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-2f9gn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-2f9gn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.882s (5.882s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.605s (4.605s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-746f6cf6d8-2f9gn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-74jxg

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-74jxg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-74jxg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-74jxg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 14.929s (14.929s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 15.585s (15.585s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-74jxg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-74jxg

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w7ms6

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

ProbeError

Readiness probe error: Get "http://10.132.0.19:8080/ready": dial tcp 10.132.0.19:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Unhealthy

Readiness probe failed: Get "http://10.132.0.19:8080/ready": dial tcp 10.132.0.19:8080: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-sx8kg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sx8kg

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-gxhkr

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.148s (3.148s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-b8c9t

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-8r4v2

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-b8c9t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-b8c9t

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-8r4v2

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8r4v2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8r4v2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8r4v2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8r4v2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.27s (2.27s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-b8c9t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.287s (2.287s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-b8c9t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-b8c9t

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gxhkr

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

multus

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

e2e-ait-856ad4e0-openshift-default-54b55f5866

SuccessfulCreate

Created pod: e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

openshift-ingress

gateway_labeler_controller

e2e-ait-856ad4e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-856ad4e0

openshift-ingress

deployment-controller

e2e-ait-856ad4e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-856ad4e0-openshift-default-54b55f5866 from 0 to 1

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.556s (2.556s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-856ad4e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-856ad4e0-cf4b74b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-856ad4e0-64c854c764

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-856ad4e0-cf4b74b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-856ad4e0-cf4b74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-856ad4e0: serviceaccount "payload-processing-e2e-ait-856ad4e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-856ad4e0-cf4b74b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-856ad4e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-856ad4e0-64c854c764 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-856ad4e0-64c854c764

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-856ad4e0-64c854c764-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-856ad4e0: serviceaccount "payload-processing-e2e-ait-856ad4e0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-856ad4e0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-856ad4e0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-856ad4e0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-856ad4e0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4be16cb1-9c11-48c3-ba4a-2e0e7fb127ad, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-856ad4e0-cf4b74b-glx2b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-856ad4e0-64c854c764-ddzcz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-856ad4e0-openshift-default-54b55f5866-wslxj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-4033a9f3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4033a9f3-gw

openshift-ingress

multus

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-4033a9f3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd

SuccessfulCreate

Created pod: e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4033a9f3-57c656c87c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4033a9f3-57c656c87c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4033a9f3: serviceaccount "payload-processing-e2e-migrate-4033a9f3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4033a9f3-57c656c87c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4033a9f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4033a9f3-57c656c87c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4033a9f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4033a9f3: serviceaccount "payload-processing-e2e-migrate-4033a9f3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:55432->10.133.0.42:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:55432->10.133.0.42:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-4033a9f3-57c656c87c-hmjq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4033a9f3-7b7899f49b-gdjgq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-38ffd343-openshift-default-d4c68b7b6

SuccessfulCreate

Created pod: e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-38ffd343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-38ffd343

openshift-ingress

deployment-controller

e2e-ait-38ffd343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-38ffd343-openshift-default-d4c68b7b6 from 0 to 1

openshift-ingress

multus

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-38ffd343: serviceaccount "payload-processing-e2e-ait-38ffd343" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-38ffd343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-38ffd343-6965bd97d8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-38ffd343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-38ffd343-69cd497ccd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-38ffd343-69cd497ccd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-38ffd343-69cd497ccd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-38ffd343-69cd497ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-38ffd343: serviceaccount "payload-processing-e2e-ait-38ffd343" not found

openshift-ingress

multus

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-4033a9f3-gw-openshift-default-dfb65ddd-ndjmh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-38ffd343-6965bd97d8-c9nnz

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-38ffd343

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-38ffd343: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-38ffd343": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-38ffd343, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85ed6bde-4d91-4345-a5df-bd81f014083a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-38ffd343-69cd497ccd-9zkc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-derive-a0bd8cb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a0bd8cb8

openshift-ingress

deployment-controller

e2e-derive-a0bd8cb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd from 0 to 1

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-38ffd343-openshift-default-d4c68b7b6-gcx8m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd

SuccessfulCreate

Created pod: e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

openshift-ingress

multus

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a0bd8cb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a0bd8cb8-698695b564 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a0bd8cb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a0bd8cb8-5fc694645d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a0bd8cb8-5fc694645d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a0bd8cb8-5fc694645d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a0bd8cb8-5fc694645d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a0bd8cb8: serviceaccount "payload-processing-e2e-derive-a0bd8cb8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a0bd8cb8: serviceaccount "payload-processing-e2e-derive-a0bd8cb8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-a0bd8cb8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-a0bd8cb8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-a0bd8cb8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-a0bd8cb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7952df1-b77e-4f8d-8810-e9ea360fafab, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-a0bd8cb8-5fc694645d-p787j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a0bd8cb8-698695b564-7j926

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-a0bd8cb8-openshift-default-687fd4f6dd-qvmms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

e2e-mt-efb491e3-openshift-default-7bcb656ddd

SuccessfulCreate

Created pod: e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

openshift-ingress

deployment-controller

e2e-mt-efb491e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-efb491e3-openshift-default-7bcb656ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-efb491e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-efb491e3

openshift-ingress

multus

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-efb491e3-84f86d747b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-efb491e3-84f86d747b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-efb491e3-84f86d747b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-efb491e3: serviceaccount "payload-processing-e2e-mt-efb491e3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-efb491e3-69c9b48d4b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-efb491e3-69c9b48d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-efb491e3: serviceaccount "payload-processing-e2e-mt-efb491e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-efb491e3-69c9b48d4b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-efb491e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-efb491e3-69c9b48d4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-efb491e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-efb491e3-84f86d747b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:39860->10.133.0.54:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:39860->10.133.0.54:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-efb491e3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-efb491e3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-efb491e3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-efb491e3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b8b4afd0-ef79-4ddc-91a6-db63979b39dc, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efb491e3-84f86d747b-28qhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efb491e3-69c9b48d4b-7cqbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-efb491e3-openshift-default-7bcb656ddd-9nkqq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-96a65772-openshift-default-546fc9768

SuccessfulCreate

Created pod: e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

openshift-ingress

deployment-controller

e2e-mt-96a65772-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-96a65772-openshift-default-546fc9768 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-96a65772

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-96a65772

openshift-ingress

multus

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-96a65772-d7964bd66

SuccessfulCreate

Created pod: payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

openshift-ingress

kubelet

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-96a65772-d7964bd66

FailedCreate

Error creating: pods "payload-processing-e2e-mt-96a65772-d7964bd66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-96a65772: serviceaccount "payload-processing-e2e-mt-96a65772" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-96a65772

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-96a65772-7dd4bc9476 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-96a65772

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-96a65772-d7964bd66 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-96a65772: serviceaccount "payload-processing-e2e-mt-96a65772" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:52504->10.133.0.58:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:52504->10.133.0.58:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-96a65772-d7964bd66-mxzm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-96a65772-7dd4bc9476-hdtvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-96a65772-openshift-default-546fc9768-l9t7w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-d392e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d392e9-openshift-default-7dfdbfd998 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d392e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d392e9

openshift-ingress

replicaset-controller

e2e-inf-a-d392e9-openshift-default-7dfdbfd998

SuccessfulCreate

Created pod: e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

openshift-ingress

multus

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d392e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d392e9: serviceaccount "payload-processing-e2e-inf-a-d392e9" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d392e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d392e9-69678465c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d392e9-69678465c4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d392e9-69678465c4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d392e9-69678465c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d392e9: serviceaccount "payload-processing-e2e-inf-a-d392e9" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:52800->10.133.0.63:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:52800->10.133.0.63:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-904baa-openshift-default-59885b7858

SuccessfulCreate

Created pod: e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

openshift-ingress

gateway_labeler_controller

e2e-inf-b-904baa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-904baa

openshift-ingress

deployment-controller

e2e-inf-b-904baa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-904baa-openshift-default-59885b7858 from 0 to 1

openshift-ingress

multus

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-904baa-647d5c89d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-904baa-647d5c89d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-904baa: serviceaccount "payload-processing-e2e-inf-b-904baa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-904baa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-904baa-647d5c89d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-904baa-647d5c89d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

openshift-ingress

multus

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-904baa: serviceaccount "payload-processing-e2e-inf-b-904baa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-904baa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-d392e9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-d392e9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-d392e9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-d392e9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9cedd3c7-0c22-4812-a9c1-215049e93de8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d392e9-7b9b47b744-dg244

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d392e9-69678465c4-scdz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-d392e9-openshift-default-7dfdbfd998-5j2bd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-904baa-68f7b75cd8-ltfcx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-904baa-647d5c89d6-pthp7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-904baa-openshift-default-59885b7858-c44r7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-7d80d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7d80d5

openshift-ingress

multus

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-7d80d5-openshift-default-555c8769b8

SuccessfulCreate

Created pod: e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

openshift-ingress

deployment-controller

e2e-api-a-7d80d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7d80d5-openshift-default-555c8769b8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7d80d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7d80d5-7d976db7d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d80d5-7d976db7d8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7d80d5-7d976db7d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d80d5: serviceaccount "payload-processing-e2e-api-a-7d80d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7d80d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7d80d5-687c689dcb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d80d5: serviceaccount "payload-processing-e2e-api-a-7d80d5" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d80d5-7d976db7d8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j
(x2)

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-84fa8d-openshift-default-659c9b64f6

SuccessfulCreate

Created pod: e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

openshift-ingress

deployment-controller

e2e-api-b-84fa8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-84fa8d-openshift-default-659c9b64f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-84fa8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-84fa8d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-84fa8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-84fa8d-5665ccf796 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84fa8d-8cc967f6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-84fa8d-8cc967f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84fa8d: serviceaccount "payload-processing-e2e-api-b-84fa8d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84fa8d-8cc967f6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84fa8d: serviceaccount "payload-processing-e2e-api-b-84fa8d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-84fa8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-84fa8d-8cc967f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82
(x2)

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d80d5-7d976db7d8-whj8j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d80d5-687c689dcb-cb5xj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-7d80d5-openshift-default-555c8769b8-z5bdf

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-84fa8d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-84fa8d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-84fa8d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-84fa8d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dc90746e-13fd-4378-95b1-e08d33370827, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84fa8d-5665ccf796-nnf82

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-84fa8d-8cc967f6-g7wgj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-fd42ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-fd42ef

openshift-ingress

deployment-controller

e2e-shared-a-fd42ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-fd42ef-openshift-default-76549c86bd from 0 to 1

openshift-ingress

multus

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-fd42ef-openshift-default-76549c86bd

SuccessfulCreate

Created pod: e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-84fa8d-openshift-default-659c9b64f6-cwwhz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-fd42ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-fd42ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-fd42ef-6bdd5b485d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-fd42ef: serviceaccount "payload-processing-e2e-shared-a-fd42ef" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-fd42ef: serviceaccount "payload-processing-e2e-shared-a-fd42ef" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-bc713f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-bc713f

openshift-ingress

replicaset-controller

e2e-shared-b-bc713f-openshift-default-77b59c65d4

SuccessfulCreate

Created pod: e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

openshift-ingress

deployment-controller

e2e-shared-b-bc713f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-bc713f-openshift-default-77b59c65d4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-bc713f: serviceaccount "payload-processing-e2e-shared-b-bc713f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-bc713f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-bc713f-599b77f67d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-bc713f-599b77f67d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-bc713f-599b77f67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-bc713f: serviceaccount "payload-processing-e2e-shared-b-bc713f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-bc713f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-bc713f-599b77f67d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

openshift-ingress

multus

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:43920->10.133.0.82:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:43920->10.133.0.82:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-968c04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-968c04-openshift-default-59cdc8ff94 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-968c04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-968c04

openshift-ingress

multus

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-968c04-openshift-default-59cdc8ff94

SuccessfulCreate

Created pod: e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-968c04: serviceaccount "payload-processing-e2e-ipp-a-968c04" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-968c04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-968c04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-968c04-686cbdc858 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-968c04-686cbdc858

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-968c04-686cbdc858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-968c04: serviceaccount "payload-processing-e2e-ipp-a-968c04" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-968c04-686cbdc858

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Unhealthy

Readiness probe failed: dial tcp 10.133.0.86:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-86ef5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-86ef5d

openshift-ingress

deployment-controller

e2e-ipp-b-86ef5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-86ef5d-openshift-default-8599459c84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-86ef5d-openshift-default-8599459c84

SuccessfulCreate

Created pod: e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86ef5d: serviceaccount "payload-processing-e2e-ipp-b-86ef5d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-86ef5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86ef5d: serviceaccount "payload-processing-e2e-ipp-b-86ef5d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-86ef5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-adb651-openshift-default-fd749d46

SuccessfulCreate

Created pod: e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

openshift-ingress

deployment-controller

e2e-ipp-cleanup-adb651-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-adb651-openshift-default-fd749d46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-adb651

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-adb651

openshift-ingress

multus

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-adb651: serviceaccount "payload-processing-e2e-ipp-cleanup-adb651" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-adb651

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-adb651

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-adb651: serviceaccount "payload-processing-e2e-ipp-cleanup-adb651" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-adb651-5b4586cbc6-cb5jt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-adb651

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-adb651: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-adb651": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-adb651, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e6922cdf-e7b6-44ce-998e-ae893c3772ff, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-adb651-6c96d65c5d-rrjcb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-adb651-openshift-default-fd749d46-sfpbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-968c04-5b49844fb4-88djz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-968c04-686cbdc858-884gq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-968c04-openshift-default-59cdc8ff94-kprj9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86ef5d-bd7f78668-dg5gg

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-86ef5d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-86ef5d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-86ef5d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-86ef5d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa347fb3-b517-48df-8d2a-35cb9b9e16de, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86ef5d-fbd96b8bd-9jtc8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-86ef5d-openshift-default-8599459c84-62dzj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-fd42ef

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-fd42ef: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-fd42ef": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-fd42ef, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9d2421bb-a207-4796-81fc-c8aecaecb42b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-fd42ef-6bdd5b485d-m6rzx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-fd42ef-fd5cc8b8d-j2dnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-fd42ef-openshift-default-76549c86bd-b7g7w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bc713f-5b8b868b7b-847th

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-bc713f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-bc713f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-bc713f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-bc713f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7a960d8f-9685-4418-9e94-484b9ab73784, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bc713f-599b77f67d-2vxj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-bc713f-openshift-default-77b59c65d4-4zv26

Killing

Stopping container istio-proxy