Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl to ip-10-0-136-165.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-b9fc5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-b9fc5 to ip-10-0-142-222.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-gndv5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gndv5 to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt to ip-10-0-136-165.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3f6c154b-openshift-default-577d7f888-99r47 to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm to ip-10-0-136-165.ec2.internal

openshift-ingress

kube-auth-proxy-8489764dcd-7bclw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8489764dcd-7bclw to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl to ip-10-0-137-226.ec2.internal

openshift-ingress

kube-auth-proxy-8489764dcd-mjxdk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk to ip-10-0-137-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6vpxf to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb to ip-10-0-137-226.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-zftxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-zftxf to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6 to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6 to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297 to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-c9kjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-c9kjx to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74 to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22 to ip-10-0-136-165.ec2.internal

openshift-ingress

router-default-69fbf496bb-v6nzt

Scheduled

Successfully assigned openshift-ingress/router-default-69fbf496bb-v6nzt to ip-10-0-142-222.ec2.internal

openshift-ingress

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Scheduled

Successfully assigned openshift-ingress/e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54 to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt to ip-10-0-136-165.ec2.internal

openshift-ingress

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2 to ip-10-0-136-165.ec2.internal

openshift-ingress

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24 to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl to ip-10-0-142-222.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz to ip-10-0-136-165.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-69fbf496bb from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-69fbf496bb

FailedCreate

Error creating: pods "router-default-69fbf496bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-69fbf496bb

FailedCreate

Error creating: pods "router-default-69fbf496bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-69fbf496bb

SuccessfulCreate

Created pod: router-default-69fbf496bb-v6nzt
(x6)

openshift-ingress

kubelet

router-default-69fbf496bb-v6nzt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-69fbf496bb-v6nzt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-69fbf496bb-v6nzt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

multus

router-default-69fbf496bb-v6nzt

AddedInterface

Add eth0 [10.132.0.7/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-69fbf496bb-v6nzt

Created

Created container: router

openshift-ingress

kubelet

router-default-69fbf496bb-v6nzt

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-8489764dcd

SuccessfulCreate

Created pod: kube-auth-proxy-8489764dcd-7bclw

openshift-ingress

multus

kube-auth-proxy-8489764dcd-mjxdk

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-7bclw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-mjxdk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8489764dcd-7bclw

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-8489764dcd

FailedCreate

Error creating: pods "kube-auth-proxy-8489764dcd-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-8489764dcd

SuccessfulCreate

Created pod: kube-auth-proxy-8489764dcd-mjxdk

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8489764dcd from 0 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-gndv5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-mjxdk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.118s (3.118s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-mjxdk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-mjxdk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-7bclw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-7bclw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8489764dcd-7bclw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.795s (4.795s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-gndv5

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.949s (2.949s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-b9fc5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-b9fc5

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.766s (2.766s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.339s (3.339s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c2kcv

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b9fc5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-gndv5

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gndv5

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6vpxf

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-c9kjx

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-zftxf

openshift-ingress

multus

payload-processing-5cc6cd444b-c9kjx

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-zftxf

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zftxf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-c9kjx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-c9kjx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zftxf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zftxf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.398s (2.398s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zftxf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-c9kjx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.449s (2.449s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-c9kjx

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

ProbeError

Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6vpxf

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-9756c1e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9756c1e3-openshift-default-6758b9cc4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-9756c1e3-openshift-default-6758b9cc4b

SuccessfulCreate

Created pod: e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

openshift-ingress

gateway_labeler_controller

e2e-ait-9756c1e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9756c1e3

openshift-ingress

multus

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9756c1e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9756c1e3-7d486bf98b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9756c1e3: serviceaccount "payload-processing-e2e-ait-9756c1e3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9756c1e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9756c1e3-7d486bf98b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9756c1e3-7d486bf98b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9756c1e3-7d486bf98b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9756c1e3: serviceaccount "payload-processing-e2e-ait-9756c1e3" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.528s (2.528s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-9756c1e3-7d486bf98b-jtncz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9756c1e3-5c5ffdc444-l6q9c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-cf4512d1-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-cf4512d1-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-cf4512d1-gw-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68

SuccessfulCreate

Created pod: e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

openshift-ingress

deployment-controller

e2e-migrate-cf4512d1-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-cf4512d1-gw-openshift-default-575564cb68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-cf4512d1-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-cf4512d1-gw

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-cf4512d1-gw-openshift-default-dockercfg-jlfr9); attempting to pull the image may not succeed.

openshift-ingress

multus

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-9756c1e3-openshift-default-6758b9cc4b-vmmbb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-cf4512d1: serviceaccount "payload-processing-e2e-migrate-cf4512d1" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-cf4512d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-cf4512d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-cf4512d1: serviceaccount "payload-processing-e2e-migrate-cf4512d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-cf4512d1-5f99cc9bb5-nvtbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cf4512d1-7b8456b484-4rp7n

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-3f6c154b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3f6c154b

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-3f6c154b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3f6c154b-openshift-default-577d7f888 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3f6c154b-openshift-default-577d7f888

SuccessfulCreate

Created pod: e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

openshift-ingress

multus

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-cf4512d1-gw-openshift-default-575564cb68-xnjfm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3f6c154b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3f6c154b-76b8866c96 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3f6c154b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3f6c154b-57bf5d848 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3f6c154b-57bf5d848

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3f6c154b-57bf5d848

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3f6c154b-57bf5d848-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3f6c154b: serviceaccount "payload-processing-e2e-ait-3f6c154b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3f6c154b: serviceaccount "payload-processing-e2e-ait-3f6c154b" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-3f6c154b-57bf5d848-qtx74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3f6c154b-76b8866c96-rrtnv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-3f6c154b-openshift-default-577d7f888-99r47

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-16e32844-openshift-default-9fcdc99f6

SuccessfulCreate

Created pod: e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

openshift-ingress

multus

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-16e32844-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-16e32844-openshift-default-9fcdc99f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-16e32844

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-16e32844

openshift-ingress

deployment-controller

payload-processing-e2e-derive-16e32844

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-16e32844-6c5bbbd74b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-16e32844

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-16e32844-8467676576 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16e32844-6c5bbbd74b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16e32844-6c5bbbd74b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-16e32844-6c5bbbd74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16e32844: serviceaccount "payload-processing-e2e-derive-16e32844" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16e32844-8467676576

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-16e32844-8467676576-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16e32844: serviceaccount "payload-processing-e2e-derive-16e32844" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16e32844-8467676576

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16e32844-8467676576-w92lf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-16e32844-6c5bbbd74b-7mlkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-derive-16e32844-openshift-default-9fcdc99f6-ghskv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-f11a0dab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f11a0dab

openshift-ingress

deployment-controller

e2e-mt-f11a0dab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f11a0dab-openshift-default-7cc7bc5c44 from 0 to 1

openshift-ingress

multus

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44

SuccessfulCreate

Created pod: e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f11a0dab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f11a0dab-68db988d58 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f11a0dab-68db988d58

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f11a0dab-68db988d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f11a0dab: serviceaccount "payload-processing-e2e-mt-f11a0dab" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f11a0dab-68db988d58

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

openshift-ingress

multus

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f11a0dab-899544d64

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f11a0dab-899544d64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f11a0dab: serviceaccount "payload-processing-e2e-mt-f11a0dab" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f11a0dab-899544d64

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f11a0dab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f11a0dab-899544d64 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-f11a0dab-68db988d58-gp9pj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f11a0dab-899544d64-mx297

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f11a0dab-openshift-default-7cc7bc5c44-22nwt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-fee88ca8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fee88ca8

openshift-ingress

deployment-controller

e2e-mt-fee88ca8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fee88ca8-openshift-default-7cd44b6c44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-fee88ca8-openshift-default-7cd44b6c44

SuccessfulCreate

Created pod: e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fee88ca8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fee88ca8-6454888978 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fee88ca8-6454888978

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fee88ca8-6454888978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fee88ca8: serviceaccount "payload-processing-e2e-mt-fee88ca8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fee88ca8-6454888978

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

openshift-ingress

multus

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fee88ca8: serviceaccount "payload-processing-e2e-mt-fee88ca8" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fee88ca8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fee88ca8-6dd8f65d88-rjwcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fee88ca8-6454888978-mmp4h

Killing

Stopping container payload-processing

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-mt-fee88ca8

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-mt-fee88ca8: failed to update payload-pre-processing-e2e-mt-fee88ca8-bx4m2 EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-mt-fee88ca8: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-mt-fee88ca8-bx4m2" not found

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-fee88ca8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-fee88ca8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-fee88ca8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-fee88ca8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2a6ef162-f2ab-485e-a286-332638d4ec74, UID in object meta:

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-fee88ca8-openshift-default-7cd44b6c44-m2xdl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-inf-a-890d1a-openshift-default-756c7b7bdd

SuccessfulCreate

Created pod: e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

openshift-ingress

gateway_labeler_controller

e2e-inf-a-890d1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-890d1a

openshift-ingress

deployment-controller

e2e-inf-a-890d1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-890d1a-openshift-default-756c7b7bdd from 0 to 1

openshift-ingress

multus

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-890d1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-890d1a-6594bd9fbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-890d1a-6594bd9fbd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-890d1a-6594bd9fbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-890d1a: serviceaccount "payload-processing-e2e-inf-a-890d1a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-890d1a: serviceaccount "payload-processing-e2e-inf-a-890d1a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-890d1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-890d1a-6594bd9fbd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

openshift-ingress

multus

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-716d7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-716d7c

openshift-ingress

replicaset-controller

e2e-inf-b-716d7c-openshift-default-759bf8c5c6

SuccessfulCreate

Created pod: e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

openshift-ingress

deployment-controller

e2e-inf-b-716d7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-716d7c-openshift-default-759bf8c5c6 from 0 to 1

openshift-ingress

multus

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-716d7c-78bd465564

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-716d7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-716d7c-78b5f96bc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-716d7c-78b5f96bc6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-716d7c-78b5f96bc6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-716d7c-78b5f96bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-716d7c: serviceaccount "payload-processing-e2e-inf-b-716d7c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-716d7c-78bd465564

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-716d7c-78bd465564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-716d7c: serviceaccount "payload-processing-e2e-inf-b-716d7c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-716d7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-716d7c-78bd465564 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:51530->10.133.0.57:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:51530->10.133.0.57:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-890d1a-8f86bdcfb-b6ltf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-890d1a-6594bd9fbd-2bgwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-890d1a-openshift-default-756c7b7bdd-cwxhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-716d7c-78bd465564-g4qnz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-716d7c-78b5f96bc6-clfbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-716d7c-openshift-default-759bf8c5c6-zd6rn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-95504a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-95504a

openshift-ingress

deployment-controller

e2e-api-a-95504a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-95504a-openshift-default-54f6f8b9d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-95504a-openshift-default-54f6f8b9d8

SuccessfulCreate

Created pod: e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

openshift-ingress

multus

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95504a-8c74b6bd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-95504a-8c74b6bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95504a: serviceaccount "payload-processing-e2e-api-a-95504a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-95504a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-95504a-8c74b6bd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95504a: serviceaccount "payload-processing-e2e-api-a-95504a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-95504a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95504a-8c74b6bd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

openshift-ingress

kubelet

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Unhealthy

Readiness probe failed: dial tcp 10.132.0.67:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-0de7a2-openshift-default-7bdf7457c6

SuccessfulCreate

Created pod: e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

openshift-ingress

gateway_labeler_controller

e2e-api-b-0de7a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0de7a2

openshift-ingress

deployment-controller

e2e-api-b-0de7a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0de7a2-openshift-default-7bdf7457c6 from 0 to 1

openshift-ingress

multus

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0de7a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0de7a2-74bdd4c448 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0de7a2-74bdd4c448

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0de7a2-74bdd4c448

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0de7a2-74bdd4c448-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0de7a2: serviceaccount "payload-processing-e2e-api-b-0de7a2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0de7a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0de7a2: serviceaccount "payload-processing-e2e-api-b-0de7a2" not found

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95504a-67c4bcc9c6-gg6xm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95504a-8c74b6bd-2xktl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-95504a-openshift-default-54f6f8b9d8-jtw22

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0de7a2-6b76ccc488-npqp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0de7a2-74bdd4c448-9qh24

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-219d48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-219d48-openshift-default-64d4bfb9bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-219d48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-219d48

openshift-ingress

kubelet

e2e-api-b-0de7a2-openshift-default-7bdf7457c6-wg9n2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-219d48-openshift-default-64d4bfb9bd

SuccessfulCreate

Created pod: e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-219d48: serviceaccount "payload-processing-e2e-shared-a-219d48" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-219d48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-219d48-cc9548b5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-219d48: serviceaccount "payload-processing-e2e-shared-a-219d48" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-219d48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-219d48-6cbfcb5ddb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:37996->10.133.0.60:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:37996->10.133.0.60:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-de2394

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-de2394

openshift-ingress

deployment-controller

e2e-shared-b-de2394-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-de2394-openshift-default-5bb99554bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-de2394-openshift-default-5bb99554bd

SuccessfulCreate

Created pod: e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

openshift-ingress

multus

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-de2394

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-de2394-65c9795d9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-de2394-58857c9d96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-de2394-58857c9d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-de2394: serviceaccount "payload-processing-e2e-shared-b-de2394" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-de2394-65c9795d9d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-de2394-65c9795d9d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-de2394-65c9795d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-de2394: serviceaccount "payload-processing-e2e-shared-b-de2394" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-de2394-58857c9d96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-de2394

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-de2394-58857c9d96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:52968->10.133.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:52968->10.133.0.61:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-0c0dc7-openshift-default-55b94554d

SuccessfulCreate

Created pod: e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

openshift-ingress

deployment-controller

e2e-ipp-a-0c0dc7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0c0dc7-openshift-default-55b94554d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0c0dc7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0c0dc7

openshift-ingress

multus

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0c0dc7: serviceaccount "payload-processing-e2e-ipp-a-0c0dc7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0c0dc7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0c0dc7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0c0dc7-77bf969548 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0c0dc7-77bf969548

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0c0dc7-77bf969548

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0c0dc7-77bf969548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0c0dc7: serviceaccount "payload-processing-e2e-ipp-a-0c0dc7" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8

SuccessfulCreate

Created pod: e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

openshift-ingress

deployment-controller

e2e-ipp-b-4b6c58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4b6c58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4b6c58
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.417s (3.417s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4b6c58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4b6c58-5cb645fc76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4b6c58: serviceaccount "payload-processing-e2e-ipp-b-4b6c58" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4b6c58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4b6c58: serviceaccount "payload-processing-e2e-ipp-b-4b6c58" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-c75b82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-c75b82

openshift-ingress

deployment-controller

e2e-ipp-cleanup-c75b82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966

SuccessfulCreate

Created pod: e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

openshift-ingress

multus

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c75b82: serviceaccount "payload-processing-e2e-ipp-cleanup-c75b82" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-c75b82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-c75b82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c75b82: serviceaccount "payload-processing-e2e-ipp-cleanup-c75b82" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c75b82-5b6df957cb-7vblf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-c75b82

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c75b82: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-c75b82": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c75b82, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a1fee3fa-bcd1-4f4e-81c1-ff7d1e9d7b58, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c75b82-dd48bb57d-lh9jb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0c0dc7-77bf969548-6z7zl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0c0dc7-69778546dd-zl7n6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-0c0dc7-openshift-default-55b94554d-vs6kc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4b6c58-5cb645fc76-6qkhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4b6c58-6b7d798588-cm7lk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-219d48-6cbfcb5ddb-pnh54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-219d48-cc9548b5b-6dm5g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-219d48-openshift-default-64d4bfb9bd-7g2hj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-de2394-65c9795d9d-bn95s

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-de2394

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-de2394: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-de2394": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-de2394, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c172e06f-e864-403d-8a96-005b476775d4, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-de2394-58857c9d96-7gp8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-de2394-openshift-default-5bb99554bd-m5t7s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: