Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 to ip-10-0-142-224.ec2.internal

openshift-ingress

kube-auth-proxy-5bfd866646-9w5w8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5bfd866646-9w5w8 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-dhspm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-dhspm to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 to ip-10-0-142-224.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-59pq2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2 to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps to ip-10-0-128-173.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz to ip-10-0-142-224.ec2.internal

openshift-ingress

kube-auth-proxy-5bfd866646-gn54l

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5bfd866646-gn54l to ip-10-0-128-173.ec2.internal

openshift-ingress

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6 to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q to ip-10-0-142-224.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh to ip-10-0-128-173.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc to ip-10-0-128-173.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp to ip-10-0-133-204.ec2.internal

openshift-ingress

router-default-5dd998b55c-hwxgl

Scheduled

Successfully assigned openshift-ingress/router-default-5dd998b55c-hwxgl to ip-10-0-128-173.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-99124e-59545f7886-6874r to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-76272d-785765d686-xmmq6 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6 to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp to ip-10-0-142-224.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-5mp5d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-5mp5d to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc to ip-10-0-133-204.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-rc9pz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-rc9pz to ip-10-0-133-204.ec2.internal

openshift-ingress

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql to ip-10-0-133-204.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5dd998b55c from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-5dd998b55c

FailedCreate

Error creating: pods "router-default-5dd998b55c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-5dd998b55c

FailedCreate

Error creating: pods "router-default-5dd998b55c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5dd998b55c

SuccessfulCreate

Created pod: router-default-5dd998b55c-hwxgl

openshift-ingress

multus

router-default-5dd998b55c-hwxgl

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5dd998b55c-hwxgl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5dd998b55c-hwxgl

Created

Created container: router

openshift-ingress

kubelet

router-default-5dd998b55c-hwxgl

Started

Started container router
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfd866646

FailedCreate

Error creating: pods "kube-auth-proxy-5bfd866646-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-gn54l

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5bfd866646-gn54l

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfd866646

SuccessfulCreate

Created pod: kube-auth-proxy-5bfd866646-9w5w8

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-9w5w8

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5bfd866646

SuccessfulCreate

Created pod: kube-auth-proxy-5bfd866646-gn54l

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5bfd866646 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-9w5w8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5bfd866646-9w5w8

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-5mp5d

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-5mp5d

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-gn54l

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-gn54l

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-gn54l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.603s (2.603s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-9w5w8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-9w5w8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5bfd866646-9w5w8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.145s (3.145s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.726s (3.726s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5mp5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.954s (2.954s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799ckltgv

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-59pq2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-59pq2

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-dhspm

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-rc9pz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dhspm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-dhspm

openshift-ingress

multus

payload-processing-5cc6cd444b-rc9pz

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-rc9pz
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dhspm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-rc9pz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.511s (2.511s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dhspm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dhspm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.541s (2.541s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-rc9pz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-rc9pz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-59pq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-59pq2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-59pq2

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-59pq2

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-59pq2

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-6abd1847

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6abd1847

openshift-ingress

replicaset-controller

e2e-ait-6abd1847-openshift-default-5789ddd6f8

SuccessfulCreate

Created pod: e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

openshift-ingress

deployment-controller

e2e-ait-6abd1847-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6abd1847-openshift-default-5789ddd6f8 from 0 to 1

openshift-ingress

multus

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6abd1847

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6abd1847

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6abd1847-5c7544d97d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6abd1847-5c7544d97d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

openshift-ingress

multus

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6abd1847-5c7544d97d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6abd1847-5c7544d97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6abd1847: serviceaccount "payload-processing-e2e-ait-6abd1847" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

openshift-ingress

kubelet

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6abd1847: serviceaccount "payload-processing-e2e-ait-6abd1847" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6abd1847-8c9cc4b8-vx2gx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6abd1847-5c7544d97d-jnvql

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-d78a04d0-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d78a04d0-gw

openshift-ingress

deployment-controller

e2e-migrate-d78a04d0-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76

SuccessfulCreate

Created pod: e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d78a04d0: serviceaccount "payload-processing-e2e-migrate-d78a04d0" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d78a04d0: serviceaccount "payload-processing-e2e-migrate-d78a04d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d78a04d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d78a04d0-8479c4d7f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d78a04d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

openshift-ingress

kubelet

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:52114->10.133.0.57:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:52114->10.133.0.57:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-d78a04d0-8479c4d7f7-j94px

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d78a04d0-6bc8f8549b-cdqdc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-7a3c8582-openshift-default-5b45f45b9d

SuccessfulCreate

Created pod: e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

openshift-ingress

deployment-controller

e2e-ait-7a3c8582-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7a3c8582-openshift-default-5b45f45b9d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-7a3c8582

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7a3c8582

openshift-ingress

multus

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7a3c8582

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7a3c8582-56cbfdcc8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7a3c8582

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7a3c8582: serviceaccount "payload-processing-e2e-ait-7a3c8582" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7a3c8582-56cbfdcc8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7a3c8582-56cbfdcc8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7a3c8582-56cbfdcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7a3c8582: serviceaccount "payload-processing-e2e-ait-7a3c8582" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:39950->10.133.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:39950->10.133.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-7a3c8582-56cbfdcc8-7qgkp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7a3c8582-cf5f7c5b4-5vmj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-f22ea10f-openshift-default-775cc754dd

SuccessfulCreate

Created pod: e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

openshift-ingress

deployment-controller

e2e-derive-f22ea10f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f22ea10f-openshift-default-775cc754dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f22ea10f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f22ea10f

openshift-ingress

multus

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f22ea10f-7d88b75dd6

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f22ea10f-7d88b75dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f22ea10f: serviceaccount "payload-processing-e2e-derive-f22ea10f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f22ea10f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f22ea10f-7d88b75dd6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f22ea10f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f22ea10f-6675769cfb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f22ea10f-7d88b75dd6

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

openshift-ingress

kubelet

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f22ea10f: serviceaccount "payload-processing-e2e-derive-f22ea10f" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8
(x2)

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-f22ea10f-7d88b75dd6-p74pm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f22ea10f-6675769cfb-l5xs8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-6d044d53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6d044d53

openshift-ingress

deployment-controller

e2e-mt-6d044d53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d044d53-openshift-default-7757948784 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6d044d53-openshift-default-7757948784

SuccessfulCreate

Created pod: e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

openshift-ingress

multus

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d044d53-5c7d778998

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d044d53-5c7d778998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d044d53: serviceaccount "payload-processing-e2e-mt-6d044d53" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d044d53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d044d53-644c44b476 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d044d53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d044d53-5c7d778998 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d044d53-5c7d778998

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d044d53-644c44b476

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d044d53-644c44b476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d044d53: serviceaccount "payload-processing-e2e-mt-6d044d53" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d044d53-644c44b476

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

openshift-ingress

kubelet

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:53970->10.133.0.63:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:53970->10.133.0.63:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-6d044d53-5c7d778998-sqrmn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d044d53-644c44b476-hgv7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-6d044d53-openshift-default-7757948784-6xcs2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-631b3d03-openshift-default-85fc6c47fb

SuccessfulCreate

Created pod: e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

openshift-ingress

gateway_labeler_controller

e2e-mt-631b3d03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-631b3d03

openshift-ingress

deployment-controller

e2e-mt-631b3d03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-631b3d03-openshift-default-85fc6c47fb from 0 to 1

openshift-ingress

multus

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-631b3d03: serviceaccount "payload-processing-e2e-mt-631b3d03" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-631b3d03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-631b3d03-757985dbbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-631b3d03-757985dbbb

FailedCreate

Error creating: pods "payload-processing-e2e-mt-631b3d03-757985dbbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-631b3d03: serviceaccount "payload-processing-e2e-mt-631b3d03" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-631b3d03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-631b3d03-757985dbbb

SuccessfulCreate

Created pod: payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-631b3d03-757985dbbb-mv4l6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-631b3d03-6454c8fdd4-dsvlp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-54fb7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-54fb7c

openshift-ingress

deployment-controller

e2e-inf-a-54fb7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-54fb7c-openshift-default-5d89dd9756 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-54fb7c-openshift-default-5d89dd9756

SuccessfulCreate

Created pod: e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

openshift-ingress

multus

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-54fb7c-8676fbf568

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-54fb7c-8676fbf568-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-54fb7c: serviceaccount "payload-processing-e2e-inf-a-54fb7c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-54fb7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-54fb7c-8676fbf568 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-54fb7c-8676fbf568

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-54fb7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-54fb7c: serviceaccount "payload-processing-e2e-inf-a-54fb7c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3b85e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3b85e1

openshift-ingress

multus

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-3b85e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3b85e1-openshift-default-85db55b8c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-3b85e1-openshift-default-85db55b8c6

SuccessfulCreate

Created pod: e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3b85e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3b85e1: serviceaccount "payload-processing-e2e-inf-b-3b85e1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3b85e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3b85e1-6f59885748 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3b85e1: serviceaccount "payload-processing-e2e-inf-b-3b85e1" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": read tcp 10.133.0.2:50566->10.133.0.67:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": read tcp 10.133.0.2:50566->10.133.0.67:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-54fb7c-8676fbf568-vzpdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-54fb7c-6b847468d4-x59qn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3b85e1-6dc9fcf7d4-rjds6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3b85e1-6f59885748-687bl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-948a62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-948a62-openshift-default-7f88b8596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-948a62-openshift-default-7f88b8596

SuccessfulCreate

Created pod: e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

openshift-ingress

gateway_labeler_controller

e2e-api-a-948a62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-948a62

openshift-ingress

multus

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-948a62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-948a62-86df66c5cb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-948a62-86df66c5cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-948a62-86df66c5cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-948a62: serviceaccount "payload-processing-e2e-api-a-948a62" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-948a62-86df66c5cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

openshift-ingress

kubelet

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-948a62-5c776d57c6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-948a62-5c776d57c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-948a62: serviceaccount "payload-processing-e2e-api-a-948a62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-948a62-5c776d57c6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-948a62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-948a62-5c776d57c6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-df352b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-df352b

openshift-ingress

deployment-controller

e2e-api-b-df352b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-df352b-openshift-default-79d4746ff4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-df352b-openshift-default-79d4746ff4

SuccessfulCreate

Created pod: e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

openshift-ingress

multus

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-df352b-88459dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-df352b-676ffff8fd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-df352b-676ffff8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-df352b: serviceaccount "payload-processing-e2e-api-b-df352b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-df352b-676ffff8fd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-df352b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-df352b-88459dd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-df352b-88459dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-df352b-88459dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-df352b: serviceaccount "payload-processing-e2e-api-b-df352b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-df352b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-df352b-676ffff8fd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-948a62-86df66c5cb-89dd7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-948a62-5c776d57c6-phb2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-df352b-676ffff8fd-q8kqn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df352b-88459dd-9t7bq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-df352b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-df352b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-df352b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-df352b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3ba661d6-0e5f-4d38-a555-0a3ce5cc92ae, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-76272d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-76272d-openshift-default-7ddf8894bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-76272d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-76272d

openshift-ingress

replicaset-controller

e2e-shared-a-76272d-openshift-default-7ddf8894bd

SuccessfulCreate

Created pod: e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

openshift-ingress

multus

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-76272d-785765d686

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-76272d-785765d686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-76272d: serviceaccount "payload-processing-e2e-shared-a-76272d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-76272d-785765d686

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-76272d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-76272d: serviceaccount "payload-processing-e2e-shared-a-76272d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-76272d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-76272d-785765d686 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-99124e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-99124e-openshift-default-84f968b88d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-99124e-openshift-default-84f968b88d

SuccessfulCreate

Created pod: e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

openshift-ingress

gateway_labeler_controller

e2e-shared-b-99124e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-99124e

openshift-ingress

multus

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-99124e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-99124e-59545f7886 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-99124e-59545f7886

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-99124e-59545f7886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-99124e: serviceaccount "payload-processing-e2e-shared-b-99124e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-99124e-76bff4c976

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-99124e-76bff4c976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-99124e: serviceaccount "payload-processing-e2e-shared-b-99124e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-99124e-76bff4c976

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-99124e-59545f7886

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-99124e-59545f7886-6874r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-99124e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-99124e-76bff4c976 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.75:9004: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bdfbca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bdfbca

openshift-ingress

deployment-controller

e2e-ipp-a-bdfbca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bdfbca-openshift-default-66cd4d699d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d

SuccessfulCreate

Created pod: e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

openshift-ingress

multus

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bdfbca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bdfbca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bdfbca: serviceaccount "payload-processing-e2e-ipp-a-bdfbca" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bdfbca: serviceaccount "payload-processing-e2e-ipp-a-bdfbca" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Unhealthy

Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

ProbeError

Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-ipp-b-33839d-openshift-default-777449bb7b

SuccessfulCreate

Created pod: e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

openshift-ingress

deployment-controller

e2e-ipp-b-33839d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-33839d-openshift-default-777449bb7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-33839d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-33839d
(x4)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-33839d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-33839d: serviceaccount "payload-processing-e2e-ipp-b-33839d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-33839d-758f5d8468

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-33839d-758f5d8468-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-33839d: serviceaccount "payload-processing-e2e-ipp-b-33839d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-33839d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-33839d-758f5d8468 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-33839d-758f5d8468

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.556s (1.556s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3e477e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3e477e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3e477e

openshift-ingress

multus

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e: serviceaccount "payload-processing-e2e-ipp-cleanup-3e477e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e: serviceaccount "payload-processing-e2e-ipp-cleanup-3e477e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3e477e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3e477e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Unhealthy

Readiness probe failed: dial tcp 10.132.0.41:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bdfbca-5686c86bd4-csh8l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bdfbca-5bfc8ffcd6-cwmtd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-33839d-6b4fbc6664-sr92w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-76272d-785765d686-xmmq6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-76272d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-76272d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-76272d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-76272d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 01fbe35a-83ae-45dc-816d-36ea3529a82a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-76272d-547fc4cdb8-wvgmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-99124e-59545f7886-6874r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-99124e-76bff4c976-59pcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q

Killing

Stopping container istio-proxy