Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a1744c-openshift-default-77bd49876-795q8 to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 to ip-10-0-138-146.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4650f4-c66b4578-hcxts to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4 to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5 to ip-10-0-132-227.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm to ip-10-0-138-146.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l5dkm to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62 to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 to ip-10-0-138-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9 to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m to ip-10-0-135-11.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-tpssf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-tpssf to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Scheduled

Successfully assigned openshift-ingress/e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4 to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-tdjm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-tdjm8 to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f to ip-10-0-132-227.ec2.internal

openshift-ingress

kube-auth-proxy-75d55f5564-8xsr5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5 to ip-10-0-138-146.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g to ip-10-0-132-227.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-lgbns

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lgbns to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9 to ip-10-0-135-11.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8 to ip-10-0-138-146.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6 to ip-10-0-135-11.ec2.internal

openshift-ingress

kube-auth-proxy-75d55f5564-tbqst

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75d55f5564-tbqst to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4 to ip-10-0-135-11.ec2.internal

openshift-ingress

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-5cvtz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-5cvtz to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn to ip-10-0-132-227.ec2.internal

openshift-ingress

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l to ip-10-0-132-227.ec2.internal

openshift-ingress

router-default-5479f5c76c-7vtwf

Scheduled

Successfully assigned openshift-ingress/router-default-5479f5c76c-7vtwf to ip-10-0-135-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9 to ip-10-0-132-227.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2 to ip-10-0-132-227.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5479f5c76c from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-5479f5c76c

FailedCreate

Error creating: pods "router-default-5479f5c76c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-5479f5c76c

FailedCreate

Error creating: pods "router-default-5479f5c76c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5479f5c76c

SuccessfulCreate

Created pod: router-default-5479f5c76c-7vtwf

openshift-ingress

kubelet

router-default-5479f5c76c-7vtwf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-5479f5c76c-7vtwf

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5479f5c76c-7vtwf

Created

Created container: router

openshift-ingress

kubelet

router-default-5479f5c76c-7vtwf

Started

Started container router
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-75d55f5564

FailedCreate

Error creating: pods "kube-auth-proxy-75d55f5564-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-75d55f5564

SuccessfulCreate

Created pod: kube-auth-proxy-75d55f5564-tbqst

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-75d55f5564 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-75d55f5564

SuccessfulCreate

Created pod: kube-auth-proxy-75d55f5564-8xsr5

openshift-ingress

multus

kube-auth-proxy-75d55f5564-8xsr5

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-75d55f5564-tbqst

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-tbqst

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-8xsr5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-lgbns

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-8xsr5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.64s (2.64s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lgbns

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-lgbns

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-8xsr5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-8xsr5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lgbns

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.077s (4.077s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lgbns

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-tbqst

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-tbqst

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.774s (5.774s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-75d55f5564-tbqst

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lgbns

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tpssf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-tpssf

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tpssf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tpssf

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-tpssf

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tpssf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.324s (3.324s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tpssf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.408s (3.408s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lgbns

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-lgbns

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

ProbeError

Startup probe error: Get "http://10.134.0.19:15021/healthz/ready": dial tcp 10.134.0.19:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm

Unhealthy

Startup probe failed: Get "http://10.134.0.19:15021/healthz/ready": dial tcp 10.134.0.19:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-l5dkm

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.6s (2.6s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-5cvtz

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-tdjm8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5cvtz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-5cvtz

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-tdjm8

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tdjm8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5cvtz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.356s (1.356s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5cvtz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5cvtz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tdjm8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tdjm8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tdjm8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.906s (2.906s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l5dkm

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-tdjm8

Unhealthy

Readiness probe failed: dial tcp 10.132.0.37:9004: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-f6bbaf0d-openshift-default-57bccd78db

SuccessfulCreate

Created pod: e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

openshift-ingress

deployment-controller

e2e-ait-f6bbaf0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f6bbaf0d-openshift-default-57bccd78db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f6bbaf0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f6bbaf0d

openshift-ingress

multus

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f6bbaf0d: serviceaccount "payload-processing-e2e-ait-f6bbaf0d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f6bbaf0d: serviceaccount "payload-processing-e2e-ait-f6bbaf0d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f6bbaf0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f6bbaf0d-cff7b46b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f6bbaf0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f6bbaf0d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f6bbaf0d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f6bbaf0d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f6bbaf0d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b032b077-4edf-4392-ba89-3bfa049419b8, UID in object meta:

openshift-ingress

kubelet

e2e-ait-f6bbaf0d-openshift-default-57bccd78db-spcd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f6bbaf0d-75f88d54b8-l5mw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f6bbaf0d-cff7b46b6-jpqvl

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-956869dd-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-956869dd-gw

openshift-ingress

deployment-controller

e2e-migrate-956869dd-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-956869dd-gw-openshift-default-547b9544d from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-956869dd-gw-openshift-default-547b9544d

SuccessfulCreate

Created pod: e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

openshift-ingress

multus

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-956869dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-956869dd-5cfb487dbf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-956869dd-5958694f9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-956869dd-5958694f9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-956869dd: serviceaccount "payload-processing-e2e-migrate-956869dd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-956869dd-5cfb487dbf

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-956869dd-5cfb487dbf

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-956869dd-5cfb487dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-956869dd: serviceaccount "payload-processing-e2e-migrate-956869dd" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-956869dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-956869dd-5958694f9b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-956869dd-5958694f9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

openshift-ingress

multus

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-956869dd-5cfb487dbf-wlc8f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-956869dd-5958694f9b-dj58g

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-c63818d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c63818d3

openshift-ingress

deployment-controller

e2e-ait-c63818d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c63818d3-openshift-default-5dc47cfb84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c63818d3-openshift-default-5dc47cfb84

SuccessfulCreate

Created pod: e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

openshift-ingress

multus

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c63818d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c63818d3-55cdf47464 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c63818d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c63818d3-57d696fd5b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c63818d3: serviceaccount "payload-processing-e2e-ait-c63818d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c63818d3-55cdf47464

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c63818d3-55cdf47464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c63818d3: serviceaccount "payload-processing-e2e-ait-c63818d3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c63818d3-55cdf47464

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-956869dd-gw-openshift-default-547b9544d-4js62

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c63818d3-57d696fd5b-4m5w4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c63818d3-55cdf47464-76tzd

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-030a9f65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-030a9f65

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-030a9f65-openshift-default-66bf9d6d5b

SuccessfulCreate

Created pod: e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

openshift-ingress

deployment-controller

e2e-derive-030a9f65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-030a9f65-openshift-default-66bf9d6d5b from 0 to 1

openshift-ingress

multus

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-c63818d3-openshift-default-5dc47cfb84-7mh6m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-030a9f65-859fd4744b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-030a9f65-84c57675b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-030a9f65-84c57675b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-030a9f65: serviceaccount "payload-processing-e2e-derive-030a9f65" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-030a9f65-84c57675b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-030a9f65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-030a9f65-84c57675b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-030a9f65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-030a9f65-859fd4744b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-030a9f65-859fd4744b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-030a9f65-859fd4744b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-030a9f65: serviceaccount "payload-processing-e2e-derive-030a9f65" not found
(x2)

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-030a9f65-84c57675b4-82g85

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-030a9f65-859fd4744b-d8hr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-030a9f65-openshift-default-66bf9d6d5b-svqz4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-b8aa042b-openshift-default-6f97667568

SuccessfulCreate

Created pod: e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

openshift-ingress

deployment-controller

e2e-mt-b8aa042b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b8aa042b-openshift-default-6f97667568 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-b8aa042b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b8aa042b

openshift-ingress

multus

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b8aa042b: serviceaccount "payload-processing-e2e-mt-b8aa042b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b8aa042b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b8aa042b-54c6db6b86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b8aa042b-54c6db6b86

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b8aa042b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b8aa042b-54c6db6b86

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b8aa042b-54c6db6b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b8aa042b: serviceaccount "payload-processing-e2e-mt-b8aa042b" not found

openshift-ingress

multus

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": read tcp 10.132.0.2:33746->10.132.0.47:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": read tcp 10.132.0.2:33746->10.132.0.47:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Unhealthy

Readiness probe failed: dial tcp 10.133.0.70:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Unhealthy

Readiness probe failed: dial tcp 10.133.0.71:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8aa042b-54d989b6cb-4zhfv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b8aa042b-54c6db6b86-tqcz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-b8aa042b-openshift-default-6f97667568-7rxlt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-9bb5bd21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9bb5bd21

openshift-ingress

deployment-controller

e2e-mt-9bb5bd21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9bb5bd21-openshift-default-6656695d68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-9bb5bd21-openshift-default-6656695d68

SuccessfulCreate

Created pod: e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

openshift-ingress

multus

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9bb5bd21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9bb5bd21-567d7745bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9bb5bd21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9bb5bd21: serviceaccount "payload-processing-e2e-mt-9bb5bd21" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9bb5bd21-567d7745bb

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9bb5bd21-567d7745bb

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9bb5bd21-567d7745bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9bb5bd21: serviceaccount "payload-processing-e2e-mt-9bb5bd21" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9bb5bd21-6b65bf5f48-sx8rv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9bb5bd21-567d7745bb-b8xhn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-9bb5bd21-openshift-default-6656695d68-4grm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-dda27e-openshift-default-6b68ffb85b

SuccessfulCreate

Created pod: e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

openshift-ingress

deployment-controller

e2e-inf-a-dda27e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-dda27e-openshift-default-6b68ffb85b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-dda27e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-dda27e

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-dda27e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dda27e-5566f49c8d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dda27e-5566f49c8d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-dda27e-5566f49c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dda27e: serviceaccount "payload-processing-e2e-inf-a-dda27e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-dda27e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-dda27e-5566f49c8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dda27e: serviceaccount "payload-processing-e2e-inf-a-dda27e" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": read tcp 10.132.0.2:55420->10.132.0.49:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": read tcp 10.132.0.2:55420->10.132.0.49:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a1744c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a1744c

openshift-ingress

multus

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-a1744c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a1744c-openshift-default-77bd49876 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a1744c-openshift-default-77bd49876

SuccessfulCreate

Created pod: e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a1744c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a1744c-75b497cc96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a1744c-75b497cc96

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a1744c-75b497cc96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a1744c: serviceaccount "payload-processing-e2e-inf-b-a1744c" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a1744c-75b497cc96

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a1744c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a1744c-7d7f66484 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a1744c: serviceaccount "payload-processing-e2e-inf-b-a1744c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Unhealthy

Readiness probe failed: dial tcp 10.133.0.81:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:50924->10.132.0.50:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:50924->10.132.0.50:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dda27e-65d5948cbd-5q4zr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dda27e-5566f49c8d-h9fpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-dda27e-openshift-default-6b68ffb85b-tp9q4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a1744c-75b497cc96-rncpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a1744c-7d7f66484-9dfqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4650f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4650f4

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-4650f4-openshift-default-68bc6cbb74

SuccessfulCreate

Created pod: e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

openshift-ingress

deployment-controller

e2e-api-a-4650f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4650f4-openshift-default-68bc6cbb74 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-a1744c-openshift-default-77bd49876-795q8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4650f4-c66b4578

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4650f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4650f4-c66b4578 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4650f4-865bd8c544

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4650f4-865bd8c544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4650f4: serviceaccount "payload-processing-e2e-api-a-4650f4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4650f4-c66b4578

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4650f4-c66b4578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4650f4: serviceaccount "payload-processing-e2e-api-a-4650f4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4650f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4650f4-865bd8c544 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4650f4-865bd8c544

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

openshift-ingress

kubelet

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-d5d9a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d5d9a9

openshift-ingress

multus

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d

SuccessfulCreate

Created pod: e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

openshift-ingress

deployment-controller

e2e-api-b-d5d9a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d5d9a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d5d9a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d5d9a9-55475bd4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d5d9a9-55475bd4b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d5d9a9-55475bd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d5d9a9: serviceaccount "payload-processing-e2e-api-b-d5d9a9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d5d9a9-55475bd4b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d5d9a9: serviceaccount "payload-processing-e2e-api-b-d5d9a9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4650f4-865bd8c544-g59rk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4650f4-c66b4578-hcxts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-4650f4-openshift-default-68bc6cbb74-t66xx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d5d9a9-7c7fccf984-v22cc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d5d9a9-55475bd4b-74b59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-d5d9a9-openshift-default-7fdd4bcd7d-zw5rm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-ebcf3a-openshift-default-687c57b444

SuccessfulCreate

Created pod: e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

openshift-ingress

deployment-controller

e2e-shared-a-ebcf3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-ebcf3a-openshift-default-687c57b444 from 0 to 1

openshift-ingress

multus

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-ebcf3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-ebcf3a

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-ebcf3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-ebcf3a-584549464 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-ebcf3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ebcf3a: serviceaccount "payload-processing-e2e-shared-a-ebcf3a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ebcf3a-584549464

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-ebcf3a-584549464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ebcf3a: serviceaccount "payload-processing-e2e-shared-a-ebcf3a" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ebcf3a-584549464

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:52614->10.132.0.53:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:52614->10.132.0.53:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-afd6d5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-afd6d5-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-afd6d5-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-b-afd6d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-afd6d5

openshift-ingress

deployment-controller

e2e-shared-b-afd6d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-afd6d5-openshift-default-5f866cd9fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb

SuccessfulCreate

Created pod: e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

openshift-ingress

multus

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

openshift-ingress

multus

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-afd6d5: serviceaccount "payload-processing-e2e-shared-b-afd6d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-afd6d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-afd6d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-afd6d5-6d7b7659d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-afd6d5: serviceaccount "payload-processing-e2e-shared-b-afd6d5" not found
(x2)

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e81b9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e81b9d

openshift-ingress

replicaset-controller

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d

SuccessfulCreate

Created pod: e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

openshift-ingress

deployment-controller

e2e-ipp-a-e81b9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e81b9d-openshift-default-859f47bd4d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e81b9d-b4888b864

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e81b9d-b4888b864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e81b9d: serviceaccount "payload-processing-e2e-ipp-a-e81b9d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e81b9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e81b9d: serviceaccount "payload-processing-e2e-ipp-a-e81b9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e81b9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e81b9d-b4888b864 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e81b9d-b4888b864

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b

SuccessfulCreate

Created pod: e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

openshift-ingress

multus

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-7c9ee4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7c9ee4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7c9ee4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7c9ee4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c9ee4: serviceaccount "payload-processing-e2e-ipp-b-7c9ee4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7c9ee4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c9ee4: serviceaccount "payload-processing-e2e-ipp-b-7c9ee4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

openshift-ingress

multus

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846

SuccessfulCreate

Created pod: e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-06c978

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-06c978

openshift-ingress

deployment-controller

e2e-ipp-cleanup-06c978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-06c978-openshift-default-59c89dc846 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-06c978

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-06c978: serviceaccount "payload-processing-e2e-ipp-cleanup-06c978" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-06c978: serviceaccount "payload-processing-e2e-ipp-cleanup-06c978" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-06c978

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c978-64dd5b654d-pkjgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c978-b5bd75c5d-snr9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e81b9d-79566c6d9b-gpdj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e81b9d-b4888b864-2tqsz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c9ee4-7f7d47b7bb-d29tz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c9ee4-7579c6d68-dfvkf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-7c9ee4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-7c9ee4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-7c9ee4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-7c9ee4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 126aca8c-8afb-4f3e-aba7-9de5552fcde1, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-7c9ee4-openshift-default-5b5c46c56b-qnj4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ebcf3a-584549464-rgkp9

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-ebcf3a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-ebcf3a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-ebcf3a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-ebcf3a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b4cb7955-4372-466b-a157-6775f0b2c83d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ebcf3a-79f6bd4c4-lwk8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-ebcf3a-openshift-default-687c57b444-lqstd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-afd6d5-6d7b7659d6-r25d2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-afd6d5-7b97ccf5fb-lctm8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-afd6d5-openshift-default-5f866cd9fb-zrmgj

Killing

Stopping container istio-proxy