Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr to ip-10-0-140-183.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zqnk6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6 to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx to ip-10-0-140-183.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-w9t8c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml to ip-10-0-132-186.ec2.internal

openshift-ingress

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Scheduled

Successfully assigned openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh to ip-10-0-131-150.ec2.internal

openshift-ingress

kube-auth-proxy-55894cd494-6gdh8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55894cd494-6gdh8 to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-xkcqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-xkcqj to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Scheduled

Successfully assigned openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5 to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-tzknq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v to ip-10-0-132-186.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc to ip-10-0-140-183.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj to ip-10-0-131-150.ec2.internal

openshift-ingress

router-default-79d6f6d9bc-nclnf

Scheduled

Successfully assigned openshift-ingress/router-default-79d6f6d9bc-nclnf to ip-10-0-131-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms to ip-10-0-140-183.ec2.internal

openshift-ingress

kube-auth-proxy-55894cd494-n5g7d

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55894cd494-n5g7d to ip-10-0-132-186.ec2.internal

openshift-ingress

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8 to ip-10-0-132-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl to ip-10-0-131-150.ec2.internal

openshift-ingress

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g to ip-10-0-132-186.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd to ip-10-0-132-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4 to ip-10-0-140-183.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-79d6f6d9bc from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x13)

openshift-ingress

replicaset-controller

router-default-79d6f6d9bc

FailedCreate

Error creating: pods "router-default-79d6f6d9bc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-79d6f6d9bc

FailedCreate

Error creating: pods "router-default-79d6f6d9bc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-79d6f6d9bc

SuccessfulCreate

Created pod: router-default-79d6f6d9bc-nclnf
(x5)

openshift-ingress

kubelet

router-default-79d6f6d9bc-nclnf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-79d6f6d9bc-nclnf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-79d6f6d9bc-nclnf

Started

Started container router

openshift-ingress

kubelet

router-default-79d6f6d9bc-nclnf

Created

Created container: router

openshift-ingress

multus

router-default-79d6f6d9bc-nclnf

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-79d6f6d9bc-nclnf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-55894cd494

SuccessfulCreate

Created pod: kube-auth-proxy-55894cd494-6gdh8

openshift-ingress

replicaset-controller

kube-auth-proxy-55894cd494

SuccessfulCreate

Created pod: kube-auth-proxy-55894cd494-n5g7d
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-55894cd494

FailedCreate

Error creating: pods "kube-auth-proxy-55894cd494-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-55894cd494 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-6gdh8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-n5g7d

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-55894cd494-n5g7d

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-55894cd494-6gdh8

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-w9t8c

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-n5g7d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.926s (2.926s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-n5g7d

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-n5g7d

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-6gdh8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.458s (4.458s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-6gdh8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55894cd494-6gdh8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-w9t8c

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.163s (3.163s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zqnk6

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799csftmj

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zqnk6

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.78s (2.78s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csftmj

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.942s (2.942s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zqnk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w9t8c

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-w9t8c

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-wl9sv

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.881s (2.881s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-tzknq

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tzknq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-tzknq

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-xkcqj

openshift-ingress

kubelet

payload-processing-5cc6cd444b-xkcqj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-xkcqj

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tzknq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.678s (2.678s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-xkcqj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-xkcqj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tzknq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-xkcqj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.598s (2.598s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tzknq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

ProbeError

Startup probe error: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-wl9sv

Unhealthy

Startup probe failed: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-165a5b4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-165a5b4f

openshift-ingress

replicaset-controller

e2e-ait-165a5b4f-openshift-default-5c49b477b4

SuccessfulCreate

Created pod: e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

openshift-ingress

deployment-controller

e2e-ait-165a5b4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-165a5b4f-openshift-default-5c49b477b4 from 0 to 1

openshift-ingress

multus

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-165a5b4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-165a5b4f-68998f968 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-165a5b4f-776df94544

SuccessfulCreate

Created pod: payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-165a5b4f-776df94544

FailedCreate

Error creating: pods "payload-processing-e2e-ait-165a5b4f-776df94544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-165a5b4f: serviceaccount "payload-processing-e2e-ait-165a5b4f" not found

openshift-ingress

multus

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-165a5b4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-165a5b4f-776df94544 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-165a5b4f-68998f968

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-165a5b4f-68998f968

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-165a5b4f-68998f968-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-165a5b4f: serviceaccount "payload-processing-e2e-ait-165a5b4f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.024s (2.024s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.203s (2.203s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-165a5b4f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-165a5b4f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 586acd84-713d-42d3-92c0-7586e3deeb87, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-e045185e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e045185e-gw

openshift-ingress

multus

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-e045185e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e045185e-gw-openshift-default-58896c9cbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd

SuccessfulCreate

Created pod: e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e045185e: serviceaccount "payload-processing-e2e-migrate-e045185e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e045185e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e045185e-5d4458795c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e045185e-5d4458795c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e045185e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e045185e-5d4458795c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e045185e-5d4458795c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e045185e: serviceaccount "payload-processing-e2e-migrate-e045185e" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

ProbeError

Readiness probe error: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-e045185e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-e045185e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-e045185e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-e045185e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d512ff37-b973-4139-9744-f9ff8f347f3a, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-cf4c6eb2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-cf4c6eb2

openshift-ingress

replicaset-controller

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd

SuccessfulCreate

Created pod: e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

openshift-ingress

deployment-controller

e2e-ait-cf4c6eb2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd from 0 to 1

openshift-ingress

multus

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-cf4c6eb2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cf4c6eb2: serviceaccount "payload-processing-e2e-ait-cf4c6eb2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-cf4c6eb2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-cf4c6eb2-68b454968 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cf4c6eb2: serviceaccount "payload-processing-e2e-ait-cf4c6eb2" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:15021/healthz/ready": read tcp 10.132.0.2:40678->10.132.0.40:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

ProbeError

Readiness probe error: Get "http://10.132.0.40:15021/healthz/ready": read tcp 10.132.0.2:40678->10.132.0.40:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-27df8036-openshift-default-b6bf45cb8

SuccessfulCreate

Created pod: e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

openshift-ingress

gateway_labeler_controller

e2e-derive-27df8036

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-27df8036

openshift-ingress

deployment-controller

e2e-derive-27df8036-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-27df8036-openshift-default-b6bf45cb8 from 0 to 1

openshift-ingress

multus

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-27df8036

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-27df8036-559dfd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-27df8036-559dfd78

SuccessfulCreate

Created pod: payload-processing-e2e-derive-27df8036-559dfd78-khqbr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-27df8036-555c4994c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-27df8036-555c4994c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-27df8036: serviceaccount "payload-processing-e2e-derive-27df8036" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-27df8036-555c4994c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-27df8036

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-27df8036-555c4994c6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-27df8036-559dfd78

FailedCreate

Error creating: pods "payload-processing-e2e-derive-27df8036-559dfd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-27df8036: serviceaccount "payload-processing-e2e-derive-27df8036" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-27df8036-559dfd78-khqbr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-5863a6bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5863a6bc

openshift-ingress

deployment-controller

e2e-mt-5863a6bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5863a6bc-openshift-default-9f656b6d from 0 to 1

openshift-ingress

multus

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-5863a6bc-openshift-default-9f656b6d

SuccessfulCreate

Created pod: e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5863a6bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

openshift-ingress

multus

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5863a6bc: serviceaccount "payload-processing-e2e-mt-5863a6bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5863a6bc: serviceaccount "payload-processing-e2e-mt-5863a6bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5863a6bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5863a6bc-7c6dfc4c66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

e2e-mt-dcc83a9c-openshift-default-565664b6dd

SuccessfulCreate

Created pod: e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

openshift-ingress

gateway_labeler_controller

e2e-mt-dcc83a9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-dcc83a9c

openshift-ingress

deployment-controller

e2e-mt-dcc83a9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-dcc83a9c-openshift-default-565664b6dd from 0 to 1

openshift-ingress

multus

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-dcc83a9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb

SuccessfulCreate

Created pod: payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb

FailedCreate

Error creating: pods "payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dcc83a9c: serviceaccount "payload-processing-e2e-mt-dcc83a9c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dcc83a9c: serviceaccount "payload-processing-e2e-mt-dcc83a9c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-dcc83a9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Unhealthy

Readiness probe failed: dial tcp 10.132.0.47:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n

Unhealthy

Readiness probe failed: dial tcp 10.132.0.46:9004: connect: connection refused

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d

SuccessfulCreate

Created pod: e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

openshift-ingress

deployment-controller

e2e-inf-a-7aabc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7aabc5-openshift-default-5fcb877d8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7aabc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7aabc5

openshift-ingress

multus

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7aabc5: serviceaccount "payload-processing-e2e-inf-a-7aabc5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7aabc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7aabc5: serviceaccount "payload-processing-e2e-inf-a-7aabc5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7aabc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-954977-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-954977-openshift-default-ffdc9896b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-954977

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-954977

openshift-ingress

replicaset-controller

e2e-inf-b-954977-openshift-default-ffdc9896b

SuccessfulCreate

Created pod: e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

openshift-ingress

multus

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-954977

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-954977: serviceaccount "payload-processing-e2e-inf-b-954977" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-954977

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-954977-6c9fcdd446 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-954977-6c9fcdd446

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-954977-6c9fcdd446

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-954977-6c9fcdd446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-954977: serviceaccount "payload-processing-e2e-inf-b-954977" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-cad7f7-openshift-default-6544df8668

SuccessfulCreate

Created pod: e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

openshift-ingress

deployment-controller

e2e-api-a-cad7f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cad7f7-openshift-default-6544df8668 from 0 to 1

openshift-ingress

multus

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-cad7f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-cad7f7

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cad7f7-77674f44c6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-cad7f7-77674f44c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cad7f7: serviceaccount "payload-processing-e2e-api-a-cad7f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-cad7f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-cad7f7-77674f44c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cad7f7-77674f44c6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-cad7f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cad7f7: serviceaccount "payload-processing-e2e-api-a-cad7f7" not found

openshift-ingress

kubelet

e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-5b0fac-openshift-default-84fcd5888d

SuccessfulCreate

Created pod: e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

openshift-ingress

gateway_labeler_controller

e2e-api-b-5b0fac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5b0fac

openshift-ingress

deployment-controller

e2e-api-b-5b0fac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5b0fac-openshift-default-84fcd5888d from 0 to 1

openshift-ingress

multus

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5b0fac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5b0fac-6d6774c564 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5b0fac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5b0fac-578bbf5888 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5b0fac-578bbf5888

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5b0fac: serviceaccount "payload-processing-e2e-api-b-5b0fac" not found

openshift-ingress

multus

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

Started

Started container payload-pre-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5b0fac-578bbf5888

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5b0fac-578bbf5888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5b0fac: serviceaccount "payload-processing-e2e-api-b-5b0fac" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:32898->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:32898->10.132.0.53:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": read tcp 10.134.0.2:54062->10.134.0.75:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": read tcp 10.134.0.2:54062->10.134.0.75:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-de344b-openshift-default-79f565d56

SuccessfulCreate

Created pod: e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

openshift-ingress

deployment-controller

e2e-shared-a-de344b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-de344b-openshift-default-79f565d56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-de344b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-de344b

openshift-ingress

multus

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-de344b-649465f6bb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-de344b-649465f6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-de344b: serviceaccount "payload-processing-e2e-shared-a-de344b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-de344b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-de344b-649465f6bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-de344b-7879dd576

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-de344b-7879dd576

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-de344b-7879dd576-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-de344b: serviceaccount "payload-processing-e2e-shared-a-de344b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-de344b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-de344b-7879dd576 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-de344b-649465f6bb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-ab99e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-ab99e9-openshift-default-696fc7b5f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-ab99e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-ab99e9

openshift-ingress

replicaset-controller

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6

SuccessfulCreate

Created pod: e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-ab99e9

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-ab99e9-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-ab99e9-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-ab99e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-ab99e9-8b676597b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-ab99e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-ab99e9-5579cb4d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-ab99e9: serviceaccount "payload-processing-e2e-shared-b-ab99e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-ab99e9-5579cb4d86

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-ab99e9-5579cb4d86

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-ab99e9-5579cb4d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-ab99e9: serviceaccount "payload-processing-e2e-shared-b-ab99e9" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": read tcp 10.134.0.2:52432->10.134.0.77:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": read tcp 10.134.0.2:52432->10.134.0.77:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d4857a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d4857a

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

e2e-ipp-a-d4857a-openshift-default-6d455bc56d

SuccessfulCreate

Created pod: e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

openshift-ingress

deployment-controller

e2e-ipp-a-d4857a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d4857a-openshift-default-6d455bc56d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.257s (3.257s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d4857a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d4857a-869b4b57fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d4857a: serviceaccount "payload-processing-e2e-ipp-a-d4857a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d4857a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d4857a-869b4b57fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d4857a-869b4b57fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d4857a-869b4b57fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d4857a: serviceaccount "payload-processing-e2e-ipp-a-d4857a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2d7b97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2d7b97

openshift-ingress

deployment-controller

e2e-ipp-b-2d7b97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2d7b97-openshift-default-9fbfb667d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d

SuccessfulCreate

Created pod: e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

openshift-ingress

multus

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d7b97: serviceaccount "payload-processing-e2e-ipp-b-2d7b97" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d7b97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d7b97-595757ffcd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d7b97-595757ffcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d7b97: serviceaccount "payload-processing-e2e-ipp-b-2d7b97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d7b97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d7b97-595757ffcd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d7b97-595757ffcd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.476s (1.476s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8eed25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8eed25

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8eed25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

openshift-ingress

multus

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8eed25: serviceaccount "payload-processing-e2e-ipp-cleanup-8eed25" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8eed25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8eed25: serviceaccount "payload-processing-e2e-ipp-cleanup-8eed25" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8eed25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8eed25-65cc966f96-hsj4v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8eed25-86c8c54558-jfwgd

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-8eed25

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8eed25: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-8eed25": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8eed25, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: be308e04-3e37-49da-8f40-9db0c6de60a9, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d4857a-openshift-default-6d455bc56d-l5vv8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d7b97-656d7fcbb4-dflml

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-2d7b97

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-2d7b97: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-2d7b97": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-2d7b97, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bcf86d19-07c7-4659-901c-512d3eccb78d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-2d7b97-openshift-default-9fbfb667d-mtw7g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-ab99e9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-ab99e9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9933dd26-18f2-471d-895f-ee99a77b56c6, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg

Killing

Stopping container istio-proxy