Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v to ip-10-0-129-50.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x to ip-10-0-142-132.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-9rkqc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9rkqc to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4 to ip-10-0-142-132.ec2.internal

openshift-ingress

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh to ip-10-0-142-132.ec2.internal

openshift-ingress

kube-auth-proxy-5d4df5cb96-dl8mh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d4df5cb96-dl8mh to ip-10-0-129-50.ec2.internal

openshift-ingress

kube-auth-proxy-5d4df5cb96-q778h

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d4df5cb96-q778h to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px to ip-10-0-142-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-bfrsf to ip-10-0-142-132.ec2.internal

openshift-ingress

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml to ip-10-0-142-132.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6 to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-9jqb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-9jqb6 to ip-10-0-129-50.ec2.internal

openshift-ingress

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86 to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4 to ip-10-0-129-50.ec2.internal

openshift-ingress

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g to ip-10-0-129-50.ec2.internal

openshift-ingress

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7 to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9 to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7 to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88 to ip-10-0-141-102.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vdkjj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdkjj to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9 to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh to ip-10-0-129-50.ec2.internal

openshift-ingress

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7 to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26 to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-7g7wm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-7g7wm to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-104d62-openshift-default-7647657476-hbjqb to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2 to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6 to ip-10-0-141-102.ec2.internal

openshift-ingress

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7 to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl to ip-10-0-129-50.ec2.internal

openshift-ingress

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j to ip-10-0-142-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg to ip-10-0-141-102.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp to ip-10-0-129-50.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz to ip-10-0-141-102.ec2.internal

openshift-ingress

router-default-6747b7576c-fs2bd

Scheduled

Successfully assigned openshift-ingress/router-default-6747b7576c-fs2bd to ip-10-0-142-132.ec2.internal

openshift-ingress

router-default-6747b7576c-fs2bd

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6747b7576c from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-6747b7576c

FailedCreate

Error creating: pods "router-default-6747b7576c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6747b7576c

FailedCreate

Error creating: pods "router-default-6747b7576c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6747b7576c

SuccessfulCreate

Created pod: router-default-6747b7576c-fs2bd
(x6)

openshift-ingress

kubelet

router-default-6747b7576c-fs2bd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6747b7576c-fs2bd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6747b7576c-fs2bd

Started

Started container router

openshift-ingress

kubelet

router-default-6747b7576c-fs2bd

Created

Created container: router

openshift-ingress

kubelet

router-default-6747b7576c-fs2bd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-6747b7576c-fs2bd

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d4df5cb96 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5d4df5cb96

SuccessfulCreate

Created pod: kube-auth-proxy-5d4df5cb96-q778h

openshift-ingress

multus

kube-auth-proxy-5d4df5cb96-dl8mh

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5d4df5cb96

SuccessfulCreate

Created pod: kube-auth-proxy-5d4df5cb96-dl8mh
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5d4df5cb96

FailedCreate

Error creating: pods "kube-auth-proxy-5d4df5cb96-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-q778h

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5d4df5cb96-q778h

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-dl8mh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-9rkqc

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-9rkqc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9rkqc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-dl8mh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.424s (2.424s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-dl8mh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-dl8mh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9rkqc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.949s (3.949s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-q778h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.28s (5.28s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-q778h

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9rkqc

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-5d4df5cb96-q778h

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9rkqc

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vdkjj

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.721s (2.721s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Started

Started container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vdkjj

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vdkjj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.861s (2.861s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrbp6

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vdkjj

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vdkjj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.569s (2.569s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc5cb6x

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vdkjj

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-9rkqc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9rkqc

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-bfrsf

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-9jqb6

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-7g7wm

openshift-ingress

kubelet

payload-processing-5cc6cd444b-7g7wm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-7g7wm

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-9jqb6

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-9jqb6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-9jqb6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-7g7wm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-9jqb6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-9jqb6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.674s (1.674s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-7g7wm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.546s (1.546s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-7g7wm

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-bfrsf

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-c67c1cbd-openshift-default-f89f647db

SuccessfulCreate

Created pod: e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

openshift-ingress

deployment-controller

e2e-ait-c67c1cbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c67c1cbd-openshift-default-f89f647db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-c67c1cbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c67c1cbd

openshift-ingress

multus

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c67c1cbd: serviceaccount "payload-processing-e2e-ait-c67c1cbd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c67c1cbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c67c1cbd: serviceaccount "payload-processing-e2e-ait-c67c1cbd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c67c1cbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c67c1cbd-66fcf4774d-ltph4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c67c1cbd-7b4ddc88cd-77pt2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-6ad9588a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6ad9588a-gw

openshift-ingress

deployment-controller

e2e-migrate-6ad9588a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6

SuccessfulCreate

Created pod: e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

openshift-ingress

multus

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-c67c1cbd-openshift-default-f89f647db-6lhvp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6ad9588a-859669b9c7

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6ad9588a-859669b9c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6ad9588a: serviceaccount "payload-processing-e2e-migrate-6ad9588a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6ad9588a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6ad9588a-859669b9c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6ad9588a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6ad9588a: serviceaccount "payload-processing-e2e-migrate-6ad9588a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6ad9588a-859669b9c7

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

openshift-ingress

multus

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

openshift-ingress

kubelet

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.356s (2.356s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:58494->10.132.0.48:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:58494->10.132.0.48:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-6ad9588a-859669b9c7-56xr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6ad9588a-94d7fc95b-59rrh

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-ae3227ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ae3227ae

openshift-ingress

deployment-controller

e2e-ait-ae3227ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ae3227ae-openshift-default-7b554db5dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ae3227ae-openshift-default-7b554db5dd

SuccessfulCreate

Created pod: e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

openshift-ingress

kubelet

e2e-migrate-6ad9588a-gw-openshift-default-6d79d644f6-cgh8c

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ae3227ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ae3227ae-57f57759b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ae3227ae: serviceaccount "payload-processing-e2e-ait-ae3227ae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ae3227ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ae3227ae-57f57759b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ae3227ae-57f57759b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ae3227ae: serviceaccount "payload-processing-e2e-ait-ae3227ae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ae3227ae-57f57759b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

openshift-ingress

multus

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

openshift-ingress

multus

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:48084->10.132.0.50:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:48084->10.132.0.50:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ae3227ae-c5bc59db8-qqn86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ae3227ae-57f57759b-hqkwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-b9e632fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b9e632fc-openshift-default-647b9b464d from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b9e632fc-openshift-default-647b9b464d

SuccessfulCreate

Created pod: e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

openshift-ingress

multus

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-b9e632fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b9e632fc

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b9e632fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b9e632fc-84d649f988

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b9e632fc-84d649f988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b9e632fc: serviceaccount "payload-processing-e2e-derive-b9e632fc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-ae3227ae-openshift-default-7b554db5dd-sbjf7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b9e632fc-84d649f988

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

openshift-ingress

multus

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b9e632fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b9e632fc-84d649f988 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b9e632fc: serviceaccount "payload-processing-e2e-derive-b9e632fc" not found
(x2)

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-b9e632fc-5fdc5d5bc4-f9lkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9e632fc-84d649f988-dv92g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-b9e632fc-openshift-default-647b9b464d-ncbml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-b45d9e9d-openshift-default-84948b9dcb

SuccessfulCreate

Created pod: e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

openshift-ingress

deployment-controller

e2e-mt-b45d9e9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b45d9e9d-openshift-default-84948b9dcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-b45d9e9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b45d9e9d

openshift-ingress

multus

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b45d9e9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b45d9e9d-697d99889d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b45d9e9d-697d99889d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b45d9e9d: serviceaccount "payload-processing-e2e-mt-b45d9e9d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b45d9e9d: serviceaccount "payload-processing-e2e-mt-b45d9e9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b45d9e9d-697d99889d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b45d9e9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b45d9e9d-697d99889d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:44834->10.132.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:44834->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-b45d9e9d-697d99889d-b9rx7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b45d9e9d-88694fb7b-vh72g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-b45d9e9d-openshift-default-84948b9dcb-w47px

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-mt-8f322d7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8f322d7b-openshift-default-5976c684cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-8f322d7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8f322d7b

openshift-ingress

replicaset-controller

e2e-mt-8f322d7b-openshift-default-5976c684cb

SuccessfulCreate

Created pod: e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

openshift-ingress

multus

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8f322d7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8f322d7b-5cb7cddf78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8f322d7b-5cb7cddf78

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8f322d7b-5cb7cddf78

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8f322d7b-5cb7cddf78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8f322d7b: serviceaccount "payload-processing-e2e-mt-8f322d7b" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8f322d7b: serviceaccount "payload-processing-e2e-mt-8f322d7b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8f322d7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8f322d7b-fb5849fb from 0 to 1

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-8f322d7b-5cb7cddf78-l8fwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8f322d7b-fb5849fb-vlstv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-8f322d7b-openshift-default-5976c684cb-zvjml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-104d62-openshift-default-7647657476

SuccessfulCreate

Created pod: e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

openshift-ingress

gateway_labeler_controller

e2e-inf-a-104d62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-104d62

openshift-ingress

deployment-controller

e2e-inf-a-104d62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-104d62-openshift-default-7647657476 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-104d62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-104d62-866ddf5c76 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-104d62-74f79577c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-104d62-74f79577c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-104d62-74f79577c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-104d62: serviceaccount "payload-processing-e2e-inf-a-104d62" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-104d62-866ddf5c76

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-104d62-866ddf5c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-104d62: serviceaccount "payload-processing-e2e-inf-a-104d62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-104d62-866ddf5c76

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-104d62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-104d62-74f79577c6 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-72fe47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-72fe47

openshift-ingress

multus

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-72fe47-openshift-default-6588b847c4

SuccessfulCreate

Created pod: e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

openshift-ingress

deployment-controller

e2e-inf-b-72fe47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-72fe47-openshift-default-6588b847c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-72fe47-7f77fcdff4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-72fe47-75ff898788

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-72fe47-75ff898788-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-72fe47: serviceaccount "payload-processing-e2e-inf-b-72fe47" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-72fe47-7f77fcdff4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-72fe47-7f77fcdff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-72fe47: serviceaccount "payload-processing-e2e-inf-b-72fe47" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-72fe47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-72fe47-7f77fcdff4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-72fe47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-72fe47-75ff898788 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-72fe47-75ff898788

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Unhealthy

Readiness probe failed: dial tcp 10.133.0.46:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-104d62

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-104d62: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-104d62": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-104d62, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e7cf0c65-83da-4b88-bde0-b36408249a82, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-104d62-74f79577c6-7fk7d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-104d62-866ddf5c76-cz9kl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-104d62-openshift-default-7647657476-hbjqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-72fe47-7f77fcdff4-vp5xg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-72fe47-75ff898788-bx58k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-72fe47-openshift-default-6588b847c4-pk6gr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-63f77a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-63f77a

openshift-ingress

deployment-controller

e2e-api-a-63f77a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-63f77a-openshift-default-55f9d74688 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-63f77a-openshift-default-55f9d74688

SuccessfulCreate

Created pod: e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

openshift-ingress

multus

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-63f77a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-63f77a-59b4f49496 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

openshift-ingress

kubelet

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-63f77a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-63f77a-59b4f49496

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-63f77a-59b4f49496-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-63f77a: serviceaccount "payload-processing-e2e-api-a-63f77a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-63f77a-59b4f49496

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-63f77a: serviceaccount "payload-processing-e2e-api-a-63f77a" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-472fa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-472fa3

openshift-ingress

replicaset-controller

e2e-api-b-472fa3-openshift-default-659b85747b

SuccessfulCreate

Created pod: e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

openshift-ingress

deployment-controller

e2e-api-b-472fa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-472fa3-openshift-default-659b85747b from 0 to 1

openshift-ingress

multus

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-472fa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-472fa3-54bb48b94d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-472fa3-54bb48b94d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-472fa3-54bb48b94d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-472fa3: serviceaccount "payload-processing-e2e-api-b-472fa3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-472fa3-54bb48b94d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

openshift-ingress

multus

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-472fa3: serviceaccount "payload-processing-e2e-api-b-472fa3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-472fa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:52134->10.132.0.64:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:52134->10.132.0.64:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-63f77a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-63f77a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-63f77a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-63f77a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1becb17c-4ca3-4afa-8ec9-278151af23fb, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-63f77a-6ff94fcb6d-697wh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-63f77a-59b4f49496-pbmn6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-63f77a-openshift-default-55f9d74688-b9k9j

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-b-472fa3-54bb48b94d-dxbp7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-472fa3-6479cf8bc6-9mm9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-a134df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-a134df-openshift-default-68cf665b6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-a134df-openshift-default-68cf665b6d

SuccessfulCreate

Created pod: e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

openshift-ingress

gateway_labeler_controller

e2e-shared-a-a134df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-a134df

openshift-ingress

multus

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-472fa3-openshift-default-659b85747b-zmkt9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a134df: serviceaccount "payload-processing-e2e-shared-a-a134df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-a134df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-a134df-855b99bbd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-a134df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-a134df-7b65b4549d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a134df-7b65b4549d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a134df-7b65b4549d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-a134df-7b65b4549d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a134df: serviceaccount "payload-processing-e2e-shared-a-a134df" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Unhealthy

Readiness probe failed: dial tcp 10.134.0.68:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-faf483

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-faf483

openshift-ingress

multus

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-faf483-openshift-default-79c444b5b8

SuccessfulCreate

Created pod: e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

openshift-ingress

deployment-controller

e2e-shared-b-faf483-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-faf483-openshift-default-79c444b5b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-faf483: serviceaccount "payload-processing-e2e-shared-b-faf483" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-faf483

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-faf483-bb8dcb954

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-faf483-bb8dcb954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-faf483: serviceaccount "payload-processing-e2e-shared-b-faf483" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-faf483-bb8dcb954

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-faf483

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-faf483-bb8dcb954 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-c6c731-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c6c731-openshift-default-69fbbf9696 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c6c731

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c6c731

openshift-ingress

replicaset-controller

e2e-ipp-a-c6c731-openshift-default-69fbbf9696

SuccessfulCreate

Created pod: e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

openshift-ingress

multus

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6c731-c7f4879bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c6c731-c7f4879bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6c731: serviceaccount "payload-processing-e2e-ipp-a-c6c731" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c6c731

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c6c731

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c6c731-c7f4879bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c6c731-c7f4879bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c6c731: serviceaccount "payload-processing-e2e-ipp-a-c6c731" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6fb213

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6fb213

openshift-ingress

replicaset-controller

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd

SuccessfulCreate

Created pod: e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

openshift-ingress

deployment-controller

e2e-ipp-b-6fb213-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd from 0 to 1

openshift-ingress

multus

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6fb213

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6fb213-585978fff6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6fb213-585978fff6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6fb213-585978fff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6fb213: serviceaccount "payload-processing-e2e-ipp-b-6fb213" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6fb213

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6fb213: serviceaccount "payload-processing-e2e-ipp-b-6fb213" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6fb213-585978fff6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-030bcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-030bcd

openshift-ingress

deployment-controller

e2e-ipp-cleanup-030bcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-030bcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-030bcd: serviceaccount "payload-processing-e2e-ipp-cleanup-030bcd" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-030bcd: serviceaccount "payload-processing-e2e-ipp-cleanup-030bcd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-030bcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-030bcd-7bfd45fc76-gjgbz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-030bcd-85566bcfc6-npnnz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-030bcd-openshift-default-76bc6656bd-bq4hk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c6c731-55dc9b4748-zgrfb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c6c731-c7f4879bd-9sk2v

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-c6c731

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-c6c731: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-c6c731": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-c6c731, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6e90ec33-0240-4938-8486-6d202c377135, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-c6c731-openshift-default-69fbbf9696-d87kn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6fb213-6b7767b8b8-hvl8v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6fb213-585978fff6-hf5dp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6fb213-openshift-default-cb8d8f5dd-fxqxh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a134df-855b99bbd4-td9b9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a134df-7b65b4549d-8c4sm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-a134df-openshift-default-68cf665b6d-8z5sh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-faf483-bb8dcb954-5gx88

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-faf483-659b7cdcd4-2xj26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-faf483-openshift-default-79c444b5b8-vqsw4

Killing

Stopping container istio-proxy