Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l to ip-10-0-140-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-952m8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-952m8 to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp to ip-10-0-140-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vbkhz to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2 to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66 to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm to ip-10-0-141-6.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-55kqc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-55kqc to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9 to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn to ip-10-0-141-6.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-snmmk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmmk to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Scheduled

Successfully assigned openshift-ingress/e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd to ip-10-0-141-6.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-wrscr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-wrscr to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6 to ip-10-0-142-140.ec2.internal

openshift-ingress

kube-auth-proxy-5fd5d97dbc-fllhj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5fd5d97dbc-fllhj to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Scheduled

Successfully assigned openshift-ingress/e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7 to ip-10-0-141-6.ec2.internal

openshift-ingress

router-default-5f5b9f5469-b26r4

Scheduled

Successfully assigned openshift-ingress/router-default-5f5b9f5469-b26r4 to ip-10-0-140-36.ec2.internal

openshift-ingress

kube-auth-proxy-5fd5d97dbc-7xtj6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5fd5d97dbc-7xtj6 to ip-10-0-140-36.ec2.internal

openshift-ingress

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Scheduled

Successfully assigned openshift-ingress/e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64 to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6 to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-83e699-67f886f846-t5b78 to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k to ip-10-0-141-6.ec2.internal

openshift-ingress

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4 to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7 to ip-10-0-141-6.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5f5b9f5469 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-5f5b9f5469

FailedCreate

Error creating: pods "router-default-5f5b9f5469-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5f5b9f5469

FailedCreate

Error creating: pods "router-default-5f5b9f5469-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5f5b9f5469

SuccessfulCreate

Created pod: router-default-5f5b9f5469-b26r4
(x6)

openshift-ingress

kubelet

router-default-5f5b9f5469-b26r4

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5f5b9f5469-b26r4

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5f5b9f5469-b26r4

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5f5b9f5469-b26r4

Started

Started container router

openshift-ingress

kubelet

router-default-5f5b9f5469-b26r4

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5f5b9f5469-b26r4

Created

Created container: router
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-5fd5d97dbc

FailedCreate

Error creating: pods "kube-auth-proxy-5fd5d97dbc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5fd5d97dbc from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5fd5d97dbc

SuccessfulCreate

Created pod: kube-auth-proxy-5fd5d97dbc-fllhj

openshift-ingress

replicaset-controller

kube-auth-proxy-5fd5d97dbc

SuccessfulCreate

Created pod: kube-auth-proxy-5fd5d97dbc-7xtj6

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-7xtj6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5fd5d97dbc-7xtj6

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-55kqc

openshift-ingress

multus

kube-auth-proxy-5fd5d97dbc-fllhj

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-fllhj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-55kqc

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-7xtj6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-7xtj6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.639s (2.639s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-7xtj6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-fllhj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.057s (4.057s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-fllhj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5fd5d97dbc-fllhj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.781s (4.781s including waiting). Image size: 181126104 bytes.

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-snmmk

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-snmmk

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.701s (2.701s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-snmmk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c4lrcw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.069s (3.069s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-55kqc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-55kqc

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-vbkhz

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-952m8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-wrscr

openshift-ingress

kubelet

payload-processing-5cc6cd444b-wrscr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-952m8

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-952m8

openshift-ingress

multus

payload-processing-5cc6cd444b-wrscr

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-952m8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.65s (3.65s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-wrscr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.708s (3.708s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-952m8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-952m8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-wrscr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-wrscr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-vbkhz

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

multus

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-ait-7f6e65b7

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-7f6e65b7-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-7f6e65b7-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-7f6e65b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7f6e65b7

openshift-ingress

replicaset-controller

e2e-ait-7f6e65b7-openshift-default-695dbb868

SuccessfulCreate

Created pod: e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

openshift-ingress

deployment-controller

e2e-ait-7f6e65b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7f6e65b7-openshift-default-695dbb868 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7f6e65b7: serviceaccount "payload-processing-e2e-ait-7f6e65b7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7f6e65b7: serviceaccount "payload-processing-e2e-ait-7f6e65b7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7f6e65b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7f6e65b7-79fd8c8f48 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7f6e65b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.641s (1.641s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.682s (1.682s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Unhealthy

Readiness probe failed: dial tcp 10.134.0.40:9004: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Unhealthy

Liveness probe failed: dial tcp 10.134.0.40:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7f6e65b7-55df7bbbd4-xt5pw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7f6e65b7-79fd8c8f48-m5pv7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-7f6e65b7-openshift-default-695dbb868-tl7td

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6

SuccessfulCreate

Created pod: e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

openshift-ingress

deployment-controller

e2e-migrate-f658717b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f658717b-gw-openshift-default-658f78fcf6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-f658717b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f658717b-gw

openshift-ingress

multus

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f658717b: serviceaccount "payload-processing-e2e-migrate-f658717b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f658717b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f658717b: serviceaccount "payload-processing-e2e-migrate-f658717b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f658717b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f658717b-6cfbc6bbd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f658717b-74c4bbd95b-2vfmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f658717b-6cfbc6bbd9-qgbd4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-f658717b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-f658717b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-f658717b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-f658717b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4a383341-8d12-4b3c-bc65-71190f4cd0ee, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-f658717b-gw-openshift-default-658f78fcf6-sw7fx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-e3c0fa8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e3c0fa8a

openshift-ingress

deployment-controller

e2e-ait-e3c0fa8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e3c0fa8a-openshift-default-945456b78 from 0 to 1

openshift-ingress

multus

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e3c0fa8a-openshift-default-945456b78

SuccessfulCreate

Created pod: e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e3c0fa8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3c0fa8a: serviceaccount "payload-processing-e2e-ait-e3c0fa8a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3c0fa8a: serviceaccount "payload-processing-e2e-ait-e3c0fa8a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e3c0fa8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-e3c0fa8a-77dcfd8bfd-xrs64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3c0fa8a-788c9dcf68-99kdd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-e3c0fa8a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-e3c0fa8a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-e3c0fa8a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-e3c0fa8a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fc95c985-cf46-49da-9fcf-996a15bde571, UID in object meta:

openshift-ingress

kubelet

e2e-ait-e3c0fa8a-openshift-default-945456b78-v6jr9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-269943c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-269943c6-openshift-default-cf9c5c4b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-269943c6-openshift-default-cf9c5c4b4

SuccessfulCreate

Created pod: e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

openshift-ingress

gateway_labeler_controller

e2e-derive-269943c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-269943c6

openshift-ingress

multus

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-269943c6-5d4746d47d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-269943c6-5d4746d47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-269943c6: serviceaccount "payload-processing-e2e-derive-269943c6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-269943c6-686b7b8d88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-269943c6-686b7b8d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-269943c6: serviceaccount "payload-processing-e2e-derive-269943c6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-269943c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-269943c6-5d4746d47d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-269943c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-269943c6-686b7b8d88 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-269943c6-686b7b8d88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

openshift-ingress

kubelet

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-269943c6-5d4746d47d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

openshift-ingress

kubelet

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-269943c6-5d4746d47d-bbr4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-269943c6-686b7b8d88-ptgf2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-269943c6-openshift-default-cf9c5c4b4-x859f

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-452dddb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-452dddb4

openshift-ingress

deployment-controller

e2e-mt-452dddb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-452dddb4-openshift-default-8cbdd8dfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-452dddb4-openshift-default-8cbdd8dfb

SuccessfulCreate

Created pod: e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

openshift-ingress

multus

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-452dddb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-452dddb4-7c95f787db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-452dddb4-7c95f787db

SuccessfulCreate

Created pod: payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

openshift-ingress

multus

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-452dddb4-7c95f787db

FailedCreate

Error creating: pods "payload-processing-e2e-mt-452dddb4-7c95f787db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-452dddb4: serviceaccount "payload-processing-e2e-mt-452dddb4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-452dddb4: serviceaccount "payload-processing-e2e-mt-452dddb4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-452dddb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-452dddb4-7c95f787db-xp29b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-452dddb4-b76f9cf4d-8vcmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-452dddb4-openshift-default-8cbdd8dfb-wqn2r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-25d7f4d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-25d7f4d7

openshift-ingress

deployment-controller

e2e-mt-25d7f4d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-25d7f4d7-openshift-default-86bd4b6564 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-25d7f4d7-openshift-default-86bd4b6564

SuccessfulCreate

Created pod: e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

openshift-ingress

multus

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25d7f4d7-6ff858f854

SuccessfulCreate

Created pod: payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-25d7f4d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-25d7f4d7-6ff858f854 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25d7f4d7: serviceaccount "payload-processing-e2e-mt-25d7f4d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-25d7f4d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25d7f4d7-6ff858f854

FailedCreate

Error creating: pods "payload-processing-e2e-mt-25d7f4d7-6ff858f854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25d7f4d7: serviceaccount "payload-processing-e2e-mt-25d7f4d7" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:36826->10.133.0.62:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:36826->10.133.0.62:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-25d7f4d7-6ff858f854-6s2vj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-25d7f4d7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-25d7f4d7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-25d7f4d7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-25d7f4d7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c67ca4ed-164b-494e-af39-67644b2ad3f0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25d7f4d7-5f5d474784-jp96p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-25d7f4d7-openshift-default-86bd4b6564-dzcff

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-849f6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-849f6b-openshift-default-8547d8dbfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-849f6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-849f6b

openshift-ingress

replicaset-controller

e2e-inf-a-849f6b-openshift-default-8547d8dbfb

SuccessfulCreate

Created pod: e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

openshift-ingress

multus

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-849f6b: serviceaccount "payload-processing-e2e-inf-a-849f6b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-849f6b-55c86ff668

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-849f6b-55c86ff668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-849f6b: serviceaccount "payload-processing-e2e-inf-a-849f6b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-849f6b-55c86ff668

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-849f6b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-849f6b-55c86ff668 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-849f6b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-0a5392

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0a5392

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-0a5392

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-0a5392-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-0a5392-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-inf-b-0a5392-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-0a5392-openshift-default-6bb698769b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-0a5392-openshift-default-6bb698769b

SuccessfulCreate

Created pod: e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

openshift-ingress

multus

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0a5392: serviceaccount "payload-processing-e2e-inf-b-0a5392" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0a5392: serviceaccount "payload-processing-e2e-inf-b-0a5392" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-0a5392

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-0a5392-7f459d6476 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-0a5392

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-0a5392-5b9b65c8dd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-849f6b-55c86ff668-tvjjq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-849f6b-5bc4d659d8-wbh66

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-849f6b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-849f6b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-849f6b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-849f6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e323988f-371d-4e87-9458-e2f98ca8cf9e, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-849f6b-openshift-default-8547d8dbfb-7njdm

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-0a5392

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-0a5392: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-0a5392": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-0a5392, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a52924fe-28a0-4e8b-ae64-81ac1b7a2149, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0a5392-5b9b65c8dd-sbw2c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0a5392-7f459d6476-57xfm

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-d453a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d453a8

openshift-ingress

kubelet

e2e-inf-b-0a5392-openshift-default-6bb698769b-gkhxr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-d453a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d453a8-openshift-default-7787b6dd86 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-d453a8-openshift-default-7787b6dd86

SuccessfulCreate

Created pod: e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d453a8: serviceaccount "payload-processing-e2e-api-a-d453a8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d453a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d453a8-6455fbf4bb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d453a8-6455fbf4bb

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d453a8-6455fbf4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d453a8: serviceaccount "payload-processing-e2e-api-a-d453a8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d453a8-6455fbf4bb

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d453a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-83e699-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-83e699-openshift-default-5d69dc9df4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-83e699-openshift-default-5d69dc9df4

SuccessfulCreate

Created pod: e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

openshift-ingress

gateway_labeler_controller

e2e-api-b-83e699

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-83e699

openshift-ingress

multus

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-83e699-67f886f846

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-83e699-67f886f846-t5b78

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-83e699

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-83e699-67f886f846 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-83e699-68d499685b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-83e699-68d499685b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-83e699: serviceaccount "payload-processing-e2e-api-b-83e699" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-83e699-68d499685b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-83e699

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-83e699-68d499685b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-83e699-67f886f846

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-83e699-67f886f846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-83e699: serviceaccount "payload-processing-e2e-api-b-83e699" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Unhealthy

Readiness probe failed: dial tcp 10.134.0.68:9004: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": read tcp 10.133.0.2:49798->10.133.0.70:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": read tcp 10.133.0.2:49798->10.133.0.70:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-d453a8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-d453a8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-d453a8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-d453a8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ca5a0589-0c72-4ec9-8e73-28d6b1ec17dd, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d453a8-86dcb66ffb-kqznr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d453a8-6455fbf4bb-6mrfh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-d453a8-openshift-default-7787b6dd86-kw9j6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83e699-68d499685b-mvctv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-83e699-67f886f846-t5b78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-83e699-openshift-default-5d69dc9df4-77kps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-c3a53e-openshift-default-59b5844548

SuccessfulCreate

Created pod: e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

openshift-ingress

deployment-controller

e2e-shared-a-c3a53e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-c3a53e-openshift-default-59b5844548 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-c3a53e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-c3a53e

openshift-ingress

multus

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-c3a53e-56b5cb77d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-c3a53e-56b5cb77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-c3a53e: serviceaccount "payload-processing-e2e-shared-a-c3a53e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-c3a53e: serviceaccount "payload-processing-e2e-shared-a-c3a53e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-c3a53e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-c3a53e-56b5cb77d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-c3a53e-56b5cb77d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-c3a53e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-f44149

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-f44149

openshift-ingress

replicaset-controller

e2e-shared-b-f44149-openshift-default-5585689fb4

SuccessfulCreate

Created pod: e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

openshift-ingress

deployment-controller

e2e-shared-b-f44149-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-f44149-openshift-default-5585689fb4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-f44149

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-f44149-5dd56d7784 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-f44149

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-f44149-54bdcf7dcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-f44149-54bdcf7dcd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-f44149-54bdcf7dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-f44149: serviceaccount "payload-processing-e2e-shared-b-f44149" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-f44149: serviceaccount "payload-processing-e2e-shared-b-f44149" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-f44149-54bdcf7dcd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-555352

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-555352

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-555352

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-555352-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-555352-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-ipp-a-555352-openshift-default-54888b6b6d

SuccessfulCreate

Created pod: e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

openshift-ingress

deployment-controller

e2e-ipp-a-555352-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-555352-openshift-default-54888b6b6d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-555352-987fc97b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-555352-c98687c76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-555352-987fc97b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-555352-987fc97b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-555352: serviceaccount "payload-processing-e2e-ipp-a-555352" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-555352

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-555352-987fc97b4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-555352

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-555352-c98687c76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-555352-c98687c76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-555352-c98687c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-555352: serviceaccount "payload-processing-e2e-ipp-a-555352" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6

SuccessfulCreate

Created pod: e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-1517d6

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-1517d6-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-1517d6-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-ipp-b-1517d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1517d6-openshift-default-5d56dfdff6 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1517d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1517d6

openshift-ingress

multus

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.818s (2.818s including waiting). Image size: 181318953 bytes.
(x3)

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1517d6: serviceaccount "payload-processing-e2e-ipp-b-1517d6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1517d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1517d6-64bffd5b6d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1517d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1517d6: serviceaccount "payload-processing-e2e-ipp-b-1517d6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

openshift-ingress

deployment-controller

e2e-ipp-cleanup-63bd67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-63bd67-openshift-default-786b98449b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-63bd67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-63bd67

openshift-ingress

multus

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-63bd67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-63bd67: serviceaccount "payload-processing-e2e-ipp-cleanup-63bd67" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-63bd67: serviceaccount "payload-processing-e2e-ipp-cleanup-63bd67" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-63bd67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-63bd67-58c9bd5f5b-rwshn

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-63bd67

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-63bd67: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-63bd67": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-63bd67, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 662f2221-8480-42d5-a2df-00747866f4b9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-63bd67-77477f577b-vx5nf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-63bd67-openshift-default-786b98449b-z9whp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Unhealthy

Readiness probe failed: dial tcp 10.134.0.74:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-555352-987fc97b4-qkkw7

Unhealthy

Readiness probe failed: dial tcp 10.134.0.75:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-555352-c98687c76-nlqqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-555352-openshift-default-54888b6b6d-wf7rx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1517d6-64bffd5b6d-qg4rn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1517d6-5d4874445b-qptkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-1517d6-openshift-default-5d56dfdff6-8bf7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-c3a53e-56b5cb77d-pdshk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-c3a53e-746b6644c6-srrnj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-c3a53e-openshift-default-59b5844548-l7lt6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f44149-54bdcf7dcd-dd59k

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-f44149

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-f44149: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-f44149": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-f44149, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5b5f0efb-7a2a-420b-8ce8-464517383d81, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f44149-5dd56d7784-jqdmg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-f44149-openshift-default-5585689fb4-gxcbw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: