Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9 to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-85370406-openshift-default-5544bddc56-vfvkf to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85 to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-5tgls

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-5tgls to ip-10-0-143-153.ec2.internal

openshift-ingress

kube-auth-proxy-54d6c599cc-7s9mh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj to ip-10-0-143-33.ec2.internal

openshift-ingress

kube-auth-proxy-54d6c599cc-b8lfk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54d6c599cc-b8lfk to ip-10-0-143-33.ec2.internal

openshift-ingress

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5 to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv to ip-10-0-143-153.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-t58rw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6 to ip-10-0-133-230.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-6pdbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp to ip-10-0-133-230.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt to ip-10-0-133-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85 to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc to ip-10-0-143-33.ec2.internal

openshift-ingress

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f to ip-10-0-143-33.ec2.internal

openshift-ingress

router-default-57f58cdc8c-xn7bm

Scheduled

Successfully assigned openshift-ingress/router-default-57f58cdc8c-xn7bm to ip-10-0-133-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-85370406-995875f66-554l2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2 to ip-10-0-143-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8 to ip-10-0-143-153.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-xz75p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p to ip-10-0-133-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2 to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z to ip-10-0-143-33.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb to ip-10-0-143-153.ec2.internal

openshift-ingress

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl to ip-10-0-143-33.ec2.internal

openshift-ingress

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9 to ip-10-0-143-33.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52 to ip-10-0-133-230.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-57f58cdc8c from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-57f58cdc8c

FailedCreate

Error creating: pods "router-default-57f58cdc8c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-57f58cdc8c

FailedCreate

Error creating: pods "router-default-57f58cdc8c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-57f58cdc8c

SuccessfulCreate

Created pod: router-default-57f58cdc8c-xn7bm
(x5)

openshift-ingress

kubelet

router-default-57f58cdc8c-xn7bm

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-57f58cdc8c-xn7bm

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-57f58cdc8c-xn7bm

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-57f58cdc8c-xn7bm

Created

Created container: router

openshift-ingress

multus

router-default-57f58cdc8c-xn7bm

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-57f58cdc8c-xn7bm

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-b8lfk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-54d6c599cc

FailedCreate

Error creating: pods "kube-auth-proxy-54d6c599cc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-54d6c599cc

SuccessfulCreate

Created pod: kube-auth-proxy-54d6c599cc-7s9mh

openshift-ingress

replicaset-controller

kube-auth-proxy-54d6c599cc

SuccessfulCreate

Created pod: kube-auth-proxy-54d6c599cc-b8lfk

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-54d6c599cc from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-7s9mh

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-54d6c599cc-b8lfk

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-54d6c599cc-7s9mh

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-t58rw

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-7s9mh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-t58rw

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t58rw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-b8lfk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-b8lfk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-b8lfk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.974s (3.974s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-7s9mh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.275s (3.275s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-7s9mh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54d6c599cc-7s9mh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t58rw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.843s (3.843s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t58rw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t58rw

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-xz75p

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-xz75p

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.859s (2.859s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 11.387s (11.387s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xz75p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t58rw

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-t58rw

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jnmtt
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-5tgls

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-6pdbs

openshift-ingress

multus

payload-processing-5cc6cd444b-5tgls

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6pdbs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-6pdbs

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5tgls

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6pdbs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5tgls

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.541s (2.541s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5tgls

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5tgls

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6pdbs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.499s (2.499s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6pdbs

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jnmtt

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-a593ec13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a593ec13

openshift-ingress

deployment-controller

e2e-ait-a593ec13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a593ec13-openshift-default-54796f78cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a593ec13-openshift-default-54796f78cb

SuccessfulCreate

Created pod: e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.559s (3.56s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a593ec13: serviceaccount "payload-processing-e2e-ait-a593ec13" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a593ec13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a593ec13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a593ec13-7b695b9bcb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a593ec13-7b695b9bcb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a593ec13-7b695b9bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a593ec13: serviceaccount "payload-processing-e2e-ait-a593ec13" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a593ec13-7b695b9bcb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Unhealthy

Readiness probe failed: Get "http://10.134.0.29:15021/healthz/ready": read tcp 10.134.0.2:37654->10.134.0.29:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

ProbeError

Readiness probe error: Get "http://10.134.0.29:15021/healthz/ready": read tcp 10.134.0.2:37654->10.134.0.29:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-c5e6a00f-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c5e6a00f-gw

openshift-ingress

multus

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-c5e6a00f-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-c5e6a00f-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-c5e6a00f-gw-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-migrate-c5e6a00f-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776

SuccessfulCreate

Created pod: e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-a593ec13-openshift-default-54796f78cb-7gjkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c5e6a00f: serviceaccount "payload-processing-e2e-migrate-c5e6a00f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c5e6a00f: serviceaccount "payload-processing-e2e-migrate-c5e6a00f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c5e6a00f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c5e6a00f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Unhealthy

Readiness probe failed: dial tcp 10.133.0.57:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Unhealthy

Readiness probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

ProbeError

Readiness probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-c5e6a00f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-c5e6a00f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc41d01f-e51a-4072-abd9-2f389c592666, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-c625014c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c625014c-openshift-default-66b5b57976 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c625014c-openshift-default-66b5b57976

SuccessfulCreate

Created pod: e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

openshift-ingress

gateway_labeler_controller

e2e-ait-c625014c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c625014c

openshift-ingress

multus

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-c5e6a00f-gw-openshift-default-5df45b776-m8sz9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c625014c-786dbf8b88

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c625014c-786dbf8b88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c625014c: serviceaccount "payload-processing-e2e-ait-c625014c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c625014c-586d58784d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c625014c-586d58784d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c625014c: serviceaccount "payload-processing-e2e-ait-c625014c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c625014c-786dbf8b88

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c625014c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c625014c-786dbf8b88 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c625014c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c625014c-586d58784d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c625014c-586d58784d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

openshift-ingress

kubelet

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-c625014c-786dbf8b88-djt24

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-f10a044c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f10a044c

openshift-ingress

replicaset-controller

e2e-derive-f10a044c-openshift-default-696c45b5dd

SuccessfulCreate

Created pod: e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

openshift-ingress

deployment-controller

e2e-derive-f10a044c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f10a044c-openshift-default-696c45b5dd from 0 to 1

openshift-ingress

multus

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-c625014c-openshift-default-66b5b57976-hq8nw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f10a044c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f10a044c-6875cd98db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f10a044c-6875cd98db

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f10a044c-6875cd98db

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f10a044c-6875cd98db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f10a044c: serviceaccount "payload-processing-e2e-derive-f10a044c" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f10a044c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f10a044c: serviceaccount "payload-processing-e2e-derive-f10a044c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-f10a044c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-f10a044c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-f10a044c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-f10a044c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 829f4a7c-0b3c-4fd8-88b1-09f04423bf10, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-f10a044c-openshift-default-696c45b5dd-q5r9x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-06db6c7f-openshift-default-6868497464

SuccessfulCreate

Created pod: e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

openshift-ingress

deployment-controller

e2e-mt-06db6c7f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-06db6c7f-openshift-default-6868497464 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-06db6c7f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-06db6c7f

openshift-ingress

multus

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-06db6c7f: serviceaccount "payload-processing-e2e-mt-06db6c7f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-06db6c7f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-06db6c7f-9d55ddbb6

FailedCreate

Error creating: pods "payload-processing-e2e-mt-06db6c7f-9d55ddbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-06db6c7f: serviceaccount "payload-processing-e2e-mt-06db6c7f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-06db6c7f-9d55ddbb6

SuccessfulCreate

Created pod: payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

openshift-ingress

deployment-controller

payload-processing-e2e-mt-06db6c7f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-06db6c7f-9d55ddbb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-06db6c7f-openshift-default-6868497464-v6rr5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-85370406

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-85370406

openshift-ingress

deployment-controller

e2e-mt-85370406-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-85370406-openshift-default-5544bddc56 from 0 to 1

openshift-ingress

multus

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-85370406-openshift-default-5544bddc56

SuccessfulCreate

Created pod: e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85370406-74c56c6f5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-85370406

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-85370406-74c56c6f5b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85370406-995875f66

SuccessfulCreate

Created pod: payload-processing-e2e-mt-85370406-995875f66-554l2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85370406-74c56c6f5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-85370406-74c56c6f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85370406: serviceaccount "payload-processing-e2e-mt-85370406" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85370406-995875f66

FailedCreate

Error creating: pods "payload-processing-e2e-mt-85370406-995875f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85370406: serviceaccount "payload-processing-e2e-mt-85370406" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-85370406

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-85370406-995875f66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-85370406-995875f66-554l2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-85370406-995875f66-554l2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-85370406-995875f66-554l2

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-85370406-995875f66-554l2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Unhealthy

Readiness probe failed: dial tcp 10.133.0.70:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-85370406-995875f66-554l2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-85370406-openshift-default-5544bddc56-vfvkf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-628283-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-628283-openshift-default-55d778fc4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-628283-openshift-default-55d778fc4d

SuccessfulCreate

Created pod: e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

openshift-ingress

gateway_labeler_controller

e2e-inf-a-628283

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-628283

openshift-ingress

multus

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-628283-6d7bf888bd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-628283-6d7bf888bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-628283: serviceaccount "payload-processing-e2e-inf-a-628283" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-628283

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-628283

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-628283-6d7bf888bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-628283-6d7bf888bd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-628283: serviceaccount "payload-processing-e2e-inf-a-628283" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-bdee41-openshift-default-65b74cc98

SuccessfulCreate

Created pod: e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

openshift-ingress

deployment-controller

e2e-inf-b-bdee41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bdee41-openshift-default-65b74cc98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bdee41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bdee41

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdee41-564f47487b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdee41-6fb44bfbb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bdee41-6fb44bfbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdee41: serviceaccount "payload-processing-e2e-inf-b-bdee41" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdee41-6fb44bfbb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bdee41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bdee41-6fb44bfbb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bdee41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bdee41-564f47487b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdee41-564f47487b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bdee41-564f47487b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdee41: serviceaccount "payload-processing-e2e-inf-b-bdee41" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-628283-openshift-default-55d778fc4d-cb2qj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-bdee41

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-bdee41": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e126f430-761c-4199-a92c-7220268790f2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-a-45e018-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-45e018-openshift-default-7cfd459d8b from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-bdee41-openshift-default-65b74cc98-cb95x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-45e018-openshift-default-7cfd459d8b

SuccessfulCreate

Created pod: e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

openshift-ingress

gateway_labeler_controller

e2e-api-a-45e018

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-45e018

openshift-ingress

multus

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-45e018-5bf8c48f7d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-45e018-5bf8c48f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-45e018: serviceaccount "payload-processing-e2e-api-a-45e018" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-45e018-58f9889788

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-45e018-58f9889788-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-45e018: serviceaccount "payload-processing-e2e-api-a-45e018" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-45e018-58f9889788

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-45e018-5bf8c48f7d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

openshift-ingress

multus

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-45e018

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-45e018-5bf8c48f7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-45e018

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-45e018-58f9889788 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-5fdbfb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5fdbfb

openshift-ingress

deployment-controller

e2e-api-b-5fdbfb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5fdbfb-openshift-default-78bd958f8d from 0 to 1

openshift-ingress

multus

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-5fdbfb-openshift-default-78bd958f8d

SuccessfulCreate

Created pod: e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5fdbfb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5fdbfb-59876545fb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5fdbfb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5fdbfb: serviceaccount "payload-processing-e2e-api-b-5fdbfb" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5fdbfb-59876545fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5fdbfb-59876545fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5fdbfb: serviceaccount "payload-processing-e2e-api-b-5fdbfb" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5fdbfb-59876545fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-45e018-openshift-default-7cfd459d8b-jqs8f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-5fdbfb-openshift-default-78bd958f8d-rfqbl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-f4dc0a-openshift-default-65f576947b

SuccessfulCreate

Created pod: e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

openshift-ingress

deployment-controller

e2e-shared-a-f4dc0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-f4dc0a-openshift-default-65f576947b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-f4dc0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-f4dc0a

openshift-ingress

multus

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-f4dc0a: serviceaccount "payload-processing-e2e-shared-a-f4dc0a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-f4dc0a: serviceaccount "payload-processing-e2e-shared-a-f4dc0a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-f4dc0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-f4dc0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": read tcp 10.134.0.2:50570->10.134.0.52:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": read tcp 10.134.0.2:50570->10.134.0.52:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-e945a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-e945a1

openshift-ingress

deployment-controller

e2e-shared-b-e945a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-e945a1-openshift-default-5dcfc45bdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd

SuccessfulCreate

Created pod: e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

openshift-ingress

multus

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-e945a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e945a1-5c9b5b596b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e945a1-5c9b5b596b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-e945a1-5c9b5b596b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e945a1: serviceaccount "payload-processing-e2e-shared-b-e945a1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-e945a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-e945a1-5c9b5b596b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e945a1: serviceaccount "payload-processing-e2e-shared-b-e945a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:56140->10.134.0.54:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:56140->10.134.0.54:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d

SuccessfulCreate

Created pod: e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-cd11f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-cd11f9

openshift-ingress

deployment-controller

e2e-ipp-a-cd11f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-cd11f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-cd11f9-6dddf984cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-cd11f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cd11f9: serviceaccount "payload-processing-e2e-ipp-a-cd11f9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cd11f9: serviceaccount "payload-processing-e2e-ipp-a-cd11f9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2a5bef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2a5bef

openshift-ingress

deployment-controller

e2e-ipp-b-2a5bef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b

SuccessfulCreate

Created pod: e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

openshift-ingress

multus

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2a5bef: serviceaccount "payload-processing-e2e-ipp-b-2a5bef" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2a5bef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2a5bef: serviceaccount "payload-processing-e2e-ipp-b-2a5bef" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2a5bef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-0e458a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-0e458a

openshift-ingress

deployment-controller

e2e-ipp-cleanup-0e458a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-0e458a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-0e458a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a: serviceaccount "payload-processing-e2e-ipp-cleanup-0e458a" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a: serviceaccount "payload-processing-e2e-ipp-cleanup-0e458a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-cd11f9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-cd11f9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1140bc6-5acf-4da6-86c8-2ff36e6c141d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-cd11f9-openshift-default-544b7d8c5d-28j5h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-f4dc0a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-f4dc0a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7b4918d5-aa7a-4341-9538-a747e91c7926, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-f4dc0a-openshift-default-65f576947b-h6kqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-e945a1-openshift-default-5dcfc45bdd-hsc8z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503