Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms to ip-10-0-142-6.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5 to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8 to ip-10-0-133-10.ec2.internal

openshift-ingress

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb to ip-10-0-133-10.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-ww47t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-ww47t to ip-10-0-142-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Scheduled

Successfully assigned openshift-ingress/e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z to ip-10-0-133-10.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6w2cb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6w2cb to ip-10-0-133-10.ec2.internal

openshift-ingress

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9 to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4 to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-68c25c-openshift-default-6796c7488-k5tln to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx to ip-10-0-133-10.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h to ip-10-0-133-10.ec2.internal

openshift-ingress

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk to ip-10-0-133-10.ec2.internal

openshift-ingress

kube-auth-proxy-94d649dc8-9v89r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-94d649dc8-9v89r to ip-10-0-133-10.ec2.internal

openshift-ingress

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj to ip-10-0-142-6.ec2.internal

openshift-ingress

kube-auth-proxy-94d649dc8-lm6p2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-94d649dc8-lm6p2 to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-47d629-openshift-default-746894d964-wplq8 to ip-10-0-142-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gf4jt to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-m7n6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-m7n6j to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv to ip-10-0-142-6.ec2.internal

openshift-ingress

router-default-877bf98d5-xbkfd

Scheduled

Successfully assigned openshift-ingress/router-default-877bf98d5-xbkfd to ip-10-0-133-10.ec2.internal

openshift-ingress

router-default-877bf98d5-xbkfd

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p to ip-10-0-135-68.ec2.internal

openshift-ingress

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6 to ip-10-0-133-10.ec2.internal

openshift-ingress

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-819bad55-openshift-default-577c6f5684-wlszm to ip-10-0-133-10.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-mt-819bad55-c85866458-4psp9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-819bad55-c85866458-4psp9 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-837664ed-5668ffdf-prz76 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv to ip-10-0-142-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr to ip-10-0-142-6.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5 to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-9k8fv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-9k8fv to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt to ip-10-0-135-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97 to ip-10-0-135-68.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-877bf98d5 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-877bf98d5

FailedCreate

Error creating: pods "router-default-877bf98d5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-877bf98d5

FailedCreate

Error creating: pods "router-default-877bf98d5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-877bf98d5

SuccessfulCreate

Created pod: router-default-877bf98d5-xbkfd
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-877bf98d5-xbkfd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-877bf98d5-xbkfd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-877bf98d5-xbkfd

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-877bf98d5-xbkfd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-877bf98d5-xbkfd

Created

Created container: router

openshift-ingress

kubelet

router-default-877bf98d5-xbkfd

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-94d649dc8

SuccessfulCreate

Created pod: kube-auth-proxy-94d649dc8-9v89r

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-94d649dc8 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-94d649dc8

SuccessfulCreate

Created pod: kube-auth-proxy-94d649dc8-lm6p2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-94d649dc8

FailedCreate

Error creating: pods "kube-auth-proxy-94d649dc8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-94d649dc8-9v89r

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-lm6p2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-94d649dc8-lm6p2

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-9v89r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6w2cb

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6w2cb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-lm6p2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.258s (3.258s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-9v89r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.299s (4.299s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-lm6p2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-lm6p2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-9v89r

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-94d649dc8-9v89r

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.248s (4.248s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-ww47t

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-ww47t

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ww47t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ww47t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.368s (3.368s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ww47t

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ww47t

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6w2cb

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6w2cb

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ddh5h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.768s (3.768s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-gf4jt

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-9k8fv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-9k8fv

openshift-ingress

multus

payload-processing-5cc6cd444b-9k8fv

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-m7n6j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-m7n6j

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-m7n6j

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-m7n6j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.732s (1.732s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-9k8fv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.7s (1.7s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-m7n6j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-9k8fv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-m7n6j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-9k8fv

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gf4jt

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-a5930c62-openshift-default-85f76b8998

SuccessfulCreate

Created pod: e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

openshift-ingress

deployment-controller

e2e-ait-a5930c62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a5930c62-openshift-default-85f76b8998 from 0 to 1

openshift-ingress

multus

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-ait-a5930c62

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-a5930c62-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-a5930c62-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-a5930c62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a5930c62

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a5930c62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a5930c62-745bcd66b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a5930c62: serviceaccount "payload-processing-e2e-ait-a5930c62" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a5930c62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a5930c62-745bcd66b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a5930c62-745bcd66b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a5930c62-745bcd66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a5930c62: serviceaccount "payload-processing-e2e-ait-a5930c62" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a5930c62-745bcd66b-h84fr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a5930c62-d8c6f4cf6-9mv2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-837664ed-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-837664ed-gw

openshift-ingress

deployment-controller

e2e-migrate-837664ed-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-837664ed-gw-openshift-default-84f6fbc484 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484

SuccessfulCreate

Created pod: e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-a5930c62-openshift-default-85f76b8998-w6bmx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-837664ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-837664ed-5668ffdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-837664ed: serviceaccount "payload-processing-e2e-migrate-837664ed" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-837664ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-837664ed-5668ffdf

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

openshift-ingress

multus

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-837664ed-5668ffdf

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-837664ed-5668ffdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-837664ed: serviceaccount "payload-processing-e2e-migrate-837664ed" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-5213aadc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5213aadc-openshift-default-5df5799b88 from 0 to 1

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-837664ed

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-837664ed: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-837664ed": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-837664ed, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9d7d2aa2-0e2d-4cc5-a379-a900095942f9, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-837664ed-5668ffdf-prz76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-837664ed-567b8b4d9b-sffmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-5213aadc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5213aadc

openshift-ingress

replicaset-controller

e2e-ait-5213aadc-openshift-default-5df5799b88

SuccessfulCreate

Created pod: e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

openshift-ingress

multus

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-837664ed-gw-openshift-default-84f6fbc484-nx8zk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5213aadc: serviceaccount "payload-processing-e2e-ait-5213aadc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5213aadc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5213aadc-6bbf9bd4d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5213aadc-6bbf9bd4d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5213aadc-6bbf9bd4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5213aadc: serviceaccount "payload-processing-e2e-ait-5213aadc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5213aadc-6bbf9bd4d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5213aadc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-5213aadc-6bbf9bd4d-zh6b9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5213aadc-5b5bbc8968-zq2sx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-06160795-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-06160795-openshift-default-c9fbbfdc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-06160795-openshift-default-c9fbbfdc6

SuccessfulCreate

Created pod: e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

openshift-ingress

gateway_labeler_controller

e2e-derive-06160795

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-06160795

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-5213aadc-openshift-default-5df5799b88-9d4g9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-derive-06160795

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-06160795-6b5cc86766 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-06160795-6b5cc86766

FailedCreate

Error creating: pods "payload-processing-e2e-derive-06160795-6b5cc86766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-06160795: serviceaccount "payload-processing-e2e-derive-06160795" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-06160795-58d9b68568

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-06160795-6b5cc86766

SuccessfulCreate

Created pod: payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-06160795-58d9b68568

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-06160795-58d9b68568-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-06160795: serviceaccount "payload-processing-e2e-derive-06160795" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-06160795

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-06160795-58d9b68568 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-06160795-6b5cc86766-6vkd5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-06160795-58d9b68568-4x9x6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-06160795-openshift-default-c9fbbfdc6-l8sdk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-819bad55-openshift-default-577c6f5684

SuccessfulCreate

Created pod: e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

openshift-ingress

deployment-controller

e2e-mt-819bad55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-819bad55-openshift-default-577c6f5684 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-819bad55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-819bad55

openshift-ingress

multus

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-819bad55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-819bad55: serviceaccount "payload-processing-e2e-mt-819bad55" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-819bad55-c85866458

FailedCreate

Error creating: pods "payload-processing-e2e-mt-819bad55-c85866458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-819bad55: serviceaccount "payload-processing-e2e-mt-819bad55" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-819bad55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-819bad55-c85866458 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-819bad55-c85866458-4psp9

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-819bad55-c85866458

SuccessfulCreate

Created pod: payload-processing-e2e-mt-819bad55-c85866458-4psp9

openshift-ingress

multus

payload-processing-e2e-mt-819bad55-c85866458-4psp9

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-819bad55-c85866458-4psp9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-819bad55-c85866458-4psp9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:42006->10.132.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:42006->10.132.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-819bad55-ff7dfdbd8-fp8nz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-819bad55-c85866458-4psp9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-819bad55

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-819bad55: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-819bad55": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-819bad55, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cabf842d-d1bc-42b3-96c3-45a23551ab53, UID in object meta:

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-819bad55-openshift-default-577c6f5684-wlszm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-80d5102b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-80d5102b-openshift-default-7cdbc97dd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-80d5102b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-80d5102b

openshift-ingress

replicaset-controller

e2e-mt-80d5102b-openshift-default-7cdbc97dd4

SuccessfulCreate

Created pod: e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-80d5102b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-80d5102b-5d8f65976d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-80d5102b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-80d5102b-5cdfdc45d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-80d5102b-5cdfdc45d6

FailedCreate

Error creating: pods "payload-processing-e2e-mt-80d5102b-5cdfdc45d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-80d5102b: serviceaccount "payload-processing-e2e-mt-80d5102b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-80d5102b: serviceaccount "payload-processing-e2e-mt-80d5102b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-80d5102b-5cdfdc45d6

SuccessfulCreate

Created pod: payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-80d5102b-5d8f65976d-j677w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-80d5102b-5cdfdc45d6-fzj9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-80d5102b-openshift-default-7cdbc97dd4-nm29z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-2239f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2239f6-openshift-default-6c64557586 from 0 to 1

openshift-ingress

multus

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2239f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2239f6

openshift-ingress

replicaset-controller

e2e-inf-a-2239f6-openshift-default-6c64557586

SuccessfulCreate

Created pod: e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2239f6-9cc599656

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2239f6-9cc599656-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2239f6: serviceaccount "payload-processing-e2e-inf-a-2239f6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2239f6-9cc599656

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2239f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2239f6-9cc599656 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2239f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2239f6-7856649d7d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2239f6-7856649d7d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2239f6-7856649d7d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2239f6-7856649d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2239f6: serviceaccount "payload-processing-e2e-inf-a-2239f6" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:50248->10.132.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:50248->10.132.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-6898ea-openshift-default-665c46654b

SuccessfulCreate

Created pod: e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

openshift-ingress

deployment-controller

e2e-inf-b-6898ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-6898ea-openshift-default-665c46654b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-6898ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-6898ea

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6898ea-564c47cb6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-6898ea-564c47cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6898ea: serviceaccount "payload-processing-e2e-inf-b-6898ea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6898ea-564c47cb6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6898ea: serviceaccount "payload-processing-e2e-inf-b-6898ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-6898ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-6898ea-54ff7589b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-6898ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-6898ea-564c47cb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": read tcp 10.132.0.2:58550->10.132.0.57:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": read tcp 10.132.0.2:58550->10.132.0.57:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2239f6-7856649d7d-6lscw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2239f6-9cc599656-8lzv2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-2239f6-openshift-default-6c64557586-fddmk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6898ea-564c47cb6-57nr8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6898ea-54ff7589b-sjjpx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-a-772c30-openshift-default-678fd7cd88

SuccessfulCreate

Created pod: e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

openshift-ingress

kubelet

e2e-inf-b-6898ea-openshift-default-665c46654b-fz6cn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-772c30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-772c30

openshift-ingress

deployment-controller

e2e-api-a-772c30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-772c30-openshift-default-678fd7cd88 from 0 to 1

openshift-ingress

multus

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-772c30-584cd5fd8d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-772c30: serviceaccount "payload-processing-e2e-api-a-772c30" not found

openshift-ingress

multus

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-772c30-584cd5fd8d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-772c30-584cd5fd8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-772c30: serviceaccount "payload-processing-e2e-api-a-772c30" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-772c30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-772c30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-772c30-584cd5fd8d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-68c25c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-68c25c

openshift-ingress

deployment-controller

e2e-api-b-68c25c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-68c25c-openshift-default-6796c7488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-68c25c-openshift-default-6796c7488

SuccessfulCreate

Created pod: e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

openshift-ingress

multus

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-68c25c-c49bd77fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-68c25c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-68c25c-c49bd77fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-68c25c-c49bd77fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-68c25c-c49bd77fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-68c25c: serviceaccount "payload-processing-e2e-api-b-68c25c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-68c25c-674b657f44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-68c25c-674b657f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-68c25c: serviceaccount "payload-processing-e2e-api-b-68c25c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-68c25c-674b657f44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-68c25c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-68c25c-674b657f44 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-772c30-7b49c8f5d8-mb26p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-772c30-584cd5fd8d-whmlt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-772c30-openshift-default-678fd7cd88-gmdm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-68c25c-674b657f44-zv4pn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-68c25c-c49bd77fb-stfr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-68c25c-openshift-default-6796c7488-k5tln

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-a47fe8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-a47fe8-openshift-default-77878545d4 from 0 to 1

openshift-ingress

multus

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-a47fe8-openshift-default-77878545d4

SuccessfulCreate

Created pod: e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

openshift-ingress

gateway_labeler_controller

e2e-shared-a-a47fe8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-a47fe8

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-a47fe8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-a47fe8-86dc5cf8db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a47fe8: serviceaccount "payload-processing-e2e-shared-a-a47fe8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-a47fe8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a47fe8: serviceaccount "payload-processing-e2e-shared-a-a47fe8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": read tcp 10.132.0.2:39946->10.132.0.60:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": read tcp 10.132.0.2:39946->10.132.0.60:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-c4c410

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-c4c410

openshift-ingress

replicaset-controller

e2e-shared-b-c4c410-openshift-default-6fdc444484

SuccessfulCreate

Created pod: e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

openshift-ingress

deployment-controller

e2e-shared-b-c4c410-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-c4c410-openshift-default-6fdc444484 from 0 to 1

openshift-ingress

multus

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-c4c410: serviceaccount "payload-processing-e2e-shared-b-c4c410" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-c4c410: serviceaccount "payload-processing-e2e-shared-b-c4c410" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-c4c410

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-c4c410

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-c4c410-7b7d4d74c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5912cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5912cb

openshift-ingress

deployment-controller

e2e-ipp-a-5912cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5912cb-openshift-default-65b755b7cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-5912cb-openshift-default-65b755b7cd

SuccessfulCreate

Created pod: e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.622s (3.622s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5912cb: serviceaccount "payload-processing-e2e-ipp-a-5912cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5912cb: serviceaccount "payload-processing-e2e-ipp-a-5912cb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5912cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5912cb-6fc86f47bb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5912cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.654s (1.654s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": read tcp 10.133.0.2:55158->10.133.0.52:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": read tcp 10.133.0.2:55158->10.133.0.52:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-47d629

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-47d629

openshift-ingress

multus

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-47d629-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-47d629-openshift-default-746894d964 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-47d629-openshift-default-746894d964

SuccessfulCreate

Created pod: e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-47d629

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-47d629-58fcfd8d64 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-47d629-58fcfd8d64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

openshift-ingress

multus

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-47d629

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-47d629-76d8595b56 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-47d629: serviceaccount "payload-processing-e2e-ipp-b-47d629" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-47d629-58fcfd8d64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-47d629-58fcfd8d64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-47d629: serviceaccount "payload-processing-e2e-ipp-b-47d629" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-ff67f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-ff67f5

openshift-ingress

deployment-controller

e2e-ipp-cleanup-ff67f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

openshift-ingress

multus

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-ff67f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-ff67f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ff67f5: serviceaccount "payload-processing-e2e-ipp-cleanup-ff67f5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ff67f5: serviceaccount "payload-processing-e2e-ipp-cleanup-ff67f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ff67f5-86b6446748-pq2h4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-ff67f5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ff67f5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-ff67f5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ff67f5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: da3978c3-f745-47b3-9b9a-033a51812f4d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ff67f5-d897b5ddd-xt7hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-ff67f5-openshift-default-69dfcf4d7b-64kkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5912cb-86f69988bd-s7c97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5912cb-6fc86f47bb-zv4lr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-5912cb-openshift-default-65b755b7cd-x7mnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-47d629-76d8595b56-sf2ms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-47d629-58fcfd8d64-drzlv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-47d629-openshift-default-746894d964-wplq8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a47fe8-86dc5cf8db-cdkm8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a47fe8-6b4764cd7b-vrsmm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-a47fe8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-a47fe8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-a47fe8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-a47fe8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d13cb034-303b-4042-ab7b-970317094a31, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-a47fe8-openshift-default-77878545d4-jj5j8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-c4c410-7b7d4d74c8-wcfrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-c4c410-566f8f4d6d-b5xvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-c4c410-openshift-default-6fdc444484-qwcwb

Killing

Stopping container istio-proxy