Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-bdfv5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5 to ip-10-0-129-12.ec2.internal

openshift-ingress

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj to ip-10-0-129-12.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6 to ip-10-0-129-12.ec2.internal

openshift-ingress

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 to ip-10-0-129-12.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kjtrs to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47 to ip-10-0-129-12.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-qfh95

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qfh95 to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5 to ip-10-0-129-12.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-77l94

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94 to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-vmjvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-vmjvs to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz to ip-10-0-139-111.ec2.internal

openshift-ingress

kube-auth-proxy-76ccb86b9-9dqb8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8 to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb to ip-10-0-129-12.ec2.internal

openshift-ingress

kube-auth-proxy-76ccb86b9-lh4m6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76ccb86b9-lh4m6 to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl to ip-10-0-129-12.ec2.internal

openshift-ingress

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7 to ip-10-0-129-12.ec2.internal

openshift-ingress

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh to ip-10-0-139-111.ec2.internal

openshift-ingress

router-default-5fb4f4744f-ltrx6

Scheduled

Successfully assigned openshift-ingress/router-default-5fb4f4744f-ltrx6 to ip-10-0-129-12.ec2.internal

openshift-ingress

router-default-5fb4f4744f-ltrx6

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-processing-e2e-mt-994302ee-8669496594-mrz46

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-994302ee-8669496594-mrz46 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs to ip-10-0-139-111.ec2.internal

openshift-ingress

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7 to ip-10-0-139-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf to ip-10-0-130-4.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7 to ip-10-0-130-4.ec2.internal

openshift-ingress

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk to ip-10-0-129-12.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l to ip-10-0-139-111.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5fb4f4744f from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-5fb4f4744f

FailedCreate

Error creating: pods "router-default-5fb4f4744f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5fb4f4744f

FailedCreate

Error creating: pods "router-default-5fb4f4744f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5fb4f4744f

SuccessfulCreate

Created pod: router-default-5fb4f4744f-ltrx6
(x6)

openshift-ingress

kubelet

router-default-5fb4f4744f-ltrx6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5fb4f4744f-ltrx6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5fb4f4744f-ltrx6

Created

Created container: router

openshift-ingress

multus

router-default-5fb4f4744f-ltrx6

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5fb4f4744f-ltrx6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5fb4f4744f-ltrx6

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-76ccb86b9

SuccessfulCreate

Created pod: kube-auth-proxy-76ccb86b9-lh4m6

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-76ccb86b9 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-76ccb86b9

FailedCreate

Error creating: pods "kube-auth-proxy-76ccb86b9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-76ccb86b9-9dqb8

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-76ccb86b9-lh4m6

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-76ccb86b9

SuccessfulCreate

Created pod: kube-auth-proxy-76ccb86b9-9dqb8

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-9dqb8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-lh4m6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-qfh95

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-qfh95

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-9dqb8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-9dqb8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.586s (2.586s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-9dqb8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-lh4m6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.762s (4.762s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.074s (4.074s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-lh4m6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-76ccb86b9-lh4m6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-77l94

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-77l94

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-77l94

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-77l94

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-77l94

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.302s (2.302s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-77l94

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-qfh95

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qgxqw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.719s (2.719s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qfh95

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-kjtrs

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-vmjvs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-bdfv5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-vmjvs
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

multus

payload-processing-5cc6cd444b-vmjvs

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bdfv5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-bdfv5

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bdfv5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bdfv5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.546s (1.546s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bdfv5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-vmjvs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.319s (3.319s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-vmjvs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-vmjvs

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kjtrs

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-8ecf692c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8ecf692c-openshift-default-878868864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-8ecf692c-openshift-default-878868864

SuccessfulCreate

Created pod: e2e-ait-8ecf692c-openshift-default-878868864-z8w47

openshift-ingress

gateway_labeler_controller

e2e-ait-8ecf692c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8ecf692c

openshift-ingress

multus

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.835s (2.835s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ecf692c-59b8d964bd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

openshift-ingress

multus

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8ecf692c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8ecf692c-5c95855488 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ecf692c-5c95855488

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8ecf692c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8ecf692c-59b8d964bd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ecf692c-5c95855488

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8ecf692c-5c95855488-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ecf692c: serviceaccount "payload-processing-e2e-ait-8ecf692c" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ecf692c-59b8d964bd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8ecf692c-59b8d964bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ecf692c: serviceaccount "payload-processing-e2e-ait-8ecf692c" not found
(x2)

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-8ecf692c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-8ecf692c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1aabdc3e-7d9e-48ff-a617-ad98601782d8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-a3bf19b0-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-a3bf19b0-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-a3bf19b0-gw-authn-ssl" already exists

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-8ecf692c-openshift-default-878868864-z8w47

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-a3bf19b0-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a3bf19b0-gw

openshift-ingress

deployment-controller

e2e-migrate-a3bf19b0-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb

SuccessfulCreate

Created pod: e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a3bf19b0: serviceaccount "payload-processing-e2e-migrate-a3bf19b0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a3bf19b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a3bf19b0: serviceaccount "payload-processing-e2e-migrate-a3bf19b0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a3bf19b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-a3bf19b0-bb4c4bdcc-dt64l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a3bf19b0-6cd9b7559b-pxwbm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-0c9d218b-openshift-default-79bc84cd66

SuccessfulCreate

Created pod: e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

openshift-ingress

multus

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-0c9d218b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0c9d218b

openshift-ingress

deployment-controller

e2e-ait-0c9d218b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0c9d218b-openshift-default-79bc84cd66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0c9d218b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d from 0 to 1

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0c9d218b: serviceaccount "payload-processing-e2e-ait-0c9d218b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0c9d218b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0c9d218b-69dccd6474 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0c9d218b-69dccd6474

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0c9d218b-69dccd6474

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0c9d218b-69dccd6474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0c9d218b: serviceaccount "payload-processing-e2e-ait-0c9d218b" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c9d218b-cc8c8db8d-htlkt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-0c9d218b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-0c9d218b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-0c9d218b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-0c9d218b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0b9e8187-950e-4037-990e-6cccdb85829f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-0c9d218b-69dccd6474-thwwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-73de3e0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-73de3e0f

openshift-ingress

replicaset-controller

e2e-derive-73de3e0f-openshift-default-6b66597656

SuccessfulCreate

Created pod: e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

openshift-ingress

deployment-controller

e2e-derive-73de3e0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-73de3e0f-openshift-default-6b66597656 from 0 to 1

openshift-ingress

multus

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-derive-73de3e0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-73de3e0f-584b9745cd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-73de3e0f: serviceaccount "payload-processing-e2e-derive-73de3e0f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-73de3e0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-73de3e0f-584b9745cd

FailedCreate

Error creating: pods "payload-processing-e2e-derive-73de3e0f-584b9745cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-73de3e0f: serviceaccount "payload-processing-e2e-derive-73de3e0f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-73de3e0f-584b9745cd

SuccessfulCreate

Created pod: payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

openshift-ingress

multus

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-73de3e0f-584b9745cd-mljwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-73de3e0f-544dd76cf6-hjzm7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-ebe3d1f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ebe3d1f6

openshift-ingress

replicaset-controller

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8

SuccessfulCreate

Created pod: e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

openshift-ingress

deployment-controller

e2e-mt-ebe3d1f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8 from 0 to 1

openshift-ingress

multus

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ebe3d1f6: serviceaccount "payload-processing-e2e-mt-ebe3d1f6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ebe3d1f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ebe3d1f6-5fb99668c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ebe3d1f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ebe3d1f6: serviceaccount "payload-processing-e2e-mt-ebe3d1f6" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ebe3d1f6-954865dbd-vjst7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-ebe3d1f6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-ebe3d1f6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-ebe3d1f6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-ebe3d1f6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ccba2b9-3827-47ca-9d0a-f2fa3737193a, UID in object meta:

openshift-ingress

kubelet

e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-994302ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-994302ee-openshift-default-654fcf5d48 from 0 to 1

openshift-ingress

multus

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-994302ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-994302ee

openshift-ingress

replicaset-controller

e2e-mt-994302ee-openshift-default-654fcf5d48

SuccessfulCreate

Created pod: e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-994302ee-8669496594

FailedCreate

Error creating: pods "payload-processing-e2e-mt-994302ee-8669496594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-994302ee: serviceaccount "payload-processing-e2e-mt-994302ee" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-994302ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-994302ee-8669496594 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-994302ee-8669496594

SuccessfulCreate

Created pod: payload-processing-e2e-mt-994302ee-8669496594-mrz46

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-994302ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-994302ee-7478b885b8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-994302ee-7478b885b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-994302ee-7478b885b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-994302ee: serviceaccount "payload-processing-e2e-mt-994302ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-994302ee-7478b885b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-994302ee-8669496594-mrz46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-994302ee-8669496594-mrz46

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-994302ee-8669496594-mrz46

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-994302ee-8669496594-mrz46

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-994302ee-7478b885b8-fjxn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-994302ee-8669496594-mrz46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e021d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e021d8

openshift-ingress

replicaset-controller

e2e-inf-a-e021d8-openshift-default-685b98795d

SuccessfulCreate

Created pod: e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

openshift-ingress

deployment-controller

e2e-inf-a-e021d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e021d8-openshift-default-685b98795d from 0 to 1

openshift-ingress

multus

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e021d8-575bb97d58

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e021d8-575bb97d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e021d8: serviceaccount "payload-processing-e2e-inf-a-e021d8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e021d8: serviceaccount "payload-processing-e2e-inf-a-e021d8" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e021d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e021d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e021d8-575bb97d58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e021d8-575bb97d58

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc
(x2)

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:55616->10.132.0.65:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:55616->10.132.0.65:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-ff425c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ff425c-openshift-default-5569798cc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ff425c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ff425c

openshift-ingress

multus

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-ff425c-openshift-default-5569798cc6

SuccessfulCreate

Created pod: e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ff425c-6dbf474fd4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ff425c-746568894d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ff425c-746568894d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ff425c: serviceaccount "payload-processing-e2e-inf-b-ff425c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ff425c-746568894d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

openshift-ingress

multus

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ff425c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ff425c-746568894d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ff425c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ff425c-6dbf474fd4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ff425c-6dbf474fd4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ff425c-6dbf474fd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ff425c: serviceaccount "payload-processing-e2e-inf-b-ff425c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Unhealthy

Readiness probe failed: dial tcp 10.133.0.63:9004: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e021d8-bcf5c58d-z4b5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff425c-6dbf474fd4-2fdqs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff425c-746568894d-h5pxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-09567c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-09567c-openshift-default-688579fcdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-09567c-openshift-default-688579fcdd

SuccessfulCreate

Created pod: e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

openshift-ingress

gateway_labeler_controller

e2e-api-a-09567c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-09567c

openshift-ingress

multus

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-09567c-5764556cf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-09567c-68bcf8fd5b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-09567c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-09567c-5764556cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-09567c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-09567c-68bcf8fd5b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-09567c-5764556cf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-09567c-5764556cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-09567c: serviceaccount "payload-processing-e2e-api-a-09567c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-09567c-68bcf8fd5b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-09567c-68bcf8fd5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-09567c: serviceaccount "payload-processing-e2e-api-a-09567c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-c3ff84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c3ff84-openshift-default-57b9f55f4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-c3ff84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c3ff84

openshift-ingress

replicaset-controller

e2e-api-b-c3ff84-openshift-default-57b9f55f4b

SuccessfulCreate

Created pod: e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c3ff84-788db79f76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c3ff84-8d795c84b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c3ff84-8d795c84b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c3ff84: serviceaccount "payload-processing-e2e-api-b-c3ff84" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c3ff84-788db79f76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c3ff84-788db79f76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c3ff84: serviceaccount "payload-processing-e2e-api-b-c3ff84" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c3ff84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c3ff84-8d795c84b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c3ff84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c3ff84-788db79f76 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c3ff84-8d795c84b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

openshift-ingress

multus

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-processing-e2e-api-a-09567c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-api-a-09567c: Operation cannot be fulfilled on endpoints "payload-processing-e2e-api-a-09567c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-api-a-09567c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b8079b51-6aa3-46b6-8d71-5eefbbd01895, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-09567c-5764556cf6-rzlqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-09567c-68bcf8fd5b-btxlb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c3ff84-788db79f76-nr9pl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-c3ff84-8d795c84b-pk6k5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-6eef04-openshift-default-b66f54796

SuccessfulCreate

Created pod: e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

openshift-ingress

gateway_labeler_controller

e2e-shared-a-6eef04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-6eef04

openshift-ingress

deployment-controller

e2e-shared-a-6eef04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-6eef04-openshift-default-b66f54796 from 0 to 1

openshift-ingress

multus

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-6eef04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-6eef04-76c4cb4c9d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-6eef04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-6eef04: serviceaccount "payload-processing-e2e-shared-a-6eef04" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-6eef04: serviceaccount "payload-processing-e2e-shared-a-6eef04" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj
(x2)

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-be8bc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-be8bc5

openshift-ingress

deployment-controller

e2e-shared-b-be8bc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-be8bc5-openshift-default-8669bb5f8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d

SuccessfulCreate

Created pod: e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

openshift-ingress

multus

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-be8bc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

openshift-ingress

multus

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-be8bc5: serviceaccount "payload-processing-e2e-shared-b-be8bc5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-be8bc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-be8bc5: serviceaccount "payload-processing-e2e-shared-b-be8bc5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Unhealthy

Readiness probe failed: dial tcp 10.133.0.72:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c210b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c210b8

openshift-ingress

deployment-controller

e2e-ipp-a-c210b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b

SuccessfulCreate

Created pod: e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

openshift-ingress

multus

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c210b8: serviceaccount "payload-processing-e2e-ipp-a-c210b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c210b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c210b8-6f6475f8c4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c210b8: serviceaccount "payload-processing-e2e-ipp-a-c210b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c210b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c210b8-6586c55556 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b1dab2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b1dab2

openshift-ingress

deployment-controller

e2e-ipp-b-b1dab2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b1dab2-openshift-default-f98489bc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b1dab2-openshift-default-f98489bc6

SuccessfulCreate

Created pod: e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

openshift-ingress

multus

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1dab2: serviceaccount "payload-processing-e2e-ipp-b-b1dab2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b1dab2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b1dab2: serviceaccount "payload-processing-e2e-ipp-b-b1dab2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b1dab2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.638s (1.638s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-aa798b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-aa798b

openshift-ingress

multus

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-aa798b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64

SuccessfulCreate

Created pod: e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b: serviceaccount "payload-processing-e2e-ipp-cleanup-aa798b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b: serviceaccount "payload-processing-e2e-ipp-cleanup-aa798b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-aa798b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-aa798b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c210b8-6f6475f8c4-qh8jc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c210b8-6586c55556-wfhhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b1dab2-78997cb8d8-fxc6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-6eef04-8469cf6cb8-5vxlk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-6eef04

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-6eef04: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-6eef04": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-6eef04, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d09ad7a2-b874-489c-9c05-343ab42fe0f8, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-6eef04-76c4cb4c9d-4l5kj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-be8bc5-6f6c4fd6f8-l882t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-be8bc5-57d59449d8-w8h52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk

Killing

Stopping container istio-proxy