Time Namespace Component RelatedObject Reason Message

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8 to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8 to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6 to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-lcqqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-lcqqd to ip-10-0-128-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v7wzs to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8 to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg to ip-10-0-128-148.ec2.internal

openshift-ingress

kube-auth-proxy-78f85fb5d-hhxvv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-78f85fb5d-hhxvv to ip-10-0-143-92.ec2.internal

openshift-ingress

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p to ip-10-0-128-148.ec2.internal

openshift-ingress

kube-auth-proxy-78f85fb5d-8dc6w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-78f85fb5d-8dc6w to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7 to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-wwts9

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-wwts9 to ip-10-0-138-165.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-9bzc7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9bzc7 to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9 to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5 to ip-10-0-143-92.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5 to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-999aa4-openshift-default-7756697448-krdx4 to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44 to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj to ip-10-0-128-148.ec2.internal

openshift-ingress

router-default-5dbccf7754-qnh7w

Scheduled

Successfully assigned openshift-ingress/router-default-5dbccf7754-qnh7w to ip-10-0-143-92.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mpvbg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mpvbg to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4 to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4 to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2 to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9 to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn to ip-10-0-128-148.ec2.internal

openshift-ingress

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg to ip-10-0-143-92.ec2.internal

openshift-ingress

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698 to ip-10-0-138-165.ec2.internal

openshift-ingress

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f924630a-openshift-default-785cd468cb-srzbc to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4 to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x to ip-10-0-143-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n to ip-10-0-143-92.ec2.internal

openshift-ingress

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

Scheduled

Successfully assigned openshift-ingress/e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn to ip-10-0-138-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv to ip-10-0-128-148.ec2.internal

openshift-ingress

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk to ip-10-0-128-148.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5dbccf7754 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-5dbccf7754

FailedCreate

Error creating: pods "router-default-5dbccf7754-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5dbccf7754

FailedCreate

Error creating: pods "router-default-5dbccf7754-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5dbccf7754

SuccessfulCreate

Created pod: router-default-5dbccf7754-qnh7w
(x6)

openshift-ingress

kubelet

router-default-5dbccf7754-qnh7w

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5dbccf7754-qnh7w

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5dbccf7754-qnh7w

Created

Created container: router

openshift-ingress

kubelet

router-default-5dbccf7754-qnh7w

Started

Started container router

openshift-ingress

kubelet

router-default-5dbccf7754-qnh7w

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-5dbccf7754-qnh7w

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-78f85fb5d

FailedCreate

Error creating: pods "kube-auth-proxy-78f85fb5d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-78f85fb5d from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-78f85fb5d

SuccessfulCreate

Created pod: kube-auth-proxy-78f85fb5d-hhxvv

openshift-ingress

replicaset-controller

kube-auth-proxy-78f85fb5d

SuccessfulCreate

Created pod: kube-auth-proxy-78f85fb5d-8dc6w

openshift-ingress

multus

kube-auth-proxy-78f85fb5d-hhxvv

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-8dc6w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-78f85fb5d-8dc6w

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-hhxvv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-9bzc7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-9bzc7

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-8dc6w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.505s (2.505s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9bzc7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-8dc6w

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-8dc6w

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-hhxvv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-hhxvv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-78f85fb5d-hhxvv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.679s (2.679s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9bzc7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9bzc7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.175s (2.175s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9bzc7

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phcfj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.371s (2.371s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mpvbg

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mpvbg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mpvbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mpvbg

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mpvbg

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-9bzc7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9bzc7

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-v7wzs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-wwts9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-lcqqd

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lcqqd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwts9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-lcqqd

openshift-ingress

multus

payload-processing-5b54b7fbb7-wwts9

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lcqqd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lcqqd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.312s (1.312s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-lcqqd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwts9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwts9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwts9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.159s (2.159s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v7wzs

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-52b585-openshift-default-fbd66cf7b

SuccessfulCreate

Created pod: e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-c8b274

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-c8b274

openshift-ingress

deployment-controller

e2e-inf-a-52b585-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-52b585-openshift-default-fbd66cf7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-52b585

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-52b585

openshift-ingress

replicaset-controller

e2e-worker-w0-b63ece-openshift-default-7cf45974d4

SuccessfulCreate

Created pod: e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

openshift-ingress

deployment-controller

e2e-worker-w0-b63ece-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b63ece-openshift-default-7cf45974d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-b63ece

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-b63ece

openshift-ingress

deployment-controller

e2e-worker-w3-c8b274-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c8b274-openshift-default-69b49d4d6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b

SuccessfulCreate

Created pod: e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

openshift-ingress

multus

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.891s (2.891s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.963s (2.963s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-b63ece

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b63ece: serviceaccount "payload-processing-e2e-worker-w0-b63ece" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b63ece: serviceaccount "payload-processing-e2e-worker-w0-b63ece" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-b63ece

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-71b1c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-71b1c2

openshift-ingress

multus

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-71b1c2-openshift-default-c85765c54

SuccessfulCreate

Created pod: e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

openshift-ingress

deployment-controller

e2e-autores-71b1c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-71b1c2-openshift-default-c85765c54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-c8b274

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-c8b274-655b68d997 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-c8b274

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c8b274: serviceaccount "payload-processing-e2e-worker-w3-c8b274" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c8b274-655b68d997

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c8b274-655b68d997

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-c8b274-655b68d997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c8b274: serviceaccount "payload-processing-e2e-worker-w3-c8b274" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-52b585

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-52b585-66df7776c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-52b585

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-52b585-64f8d5854b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

Created

Created container: payload-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52b585-66df7776c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-52b585-66df7776c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52b585: serviceaccount "payload-processing-e2e-inf-a-52b585" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52b585: serviceaccount "payload-processing-e2e-inf-a-52b585" not found

openshift-ingress

replicaset-controller

e2e-ait-aa3ba758-openshift-default-8dcc96656

SuccessfulCreate

Created pod: e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

e2e-ait-aa3ba758-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-aa3ba758-openshift-default-8dcc96656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-aa3ba758

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-aa3ba758

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52b585-66df7776c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71b1c2: serviceaccount "payload-processing-e2e-autores-71b1c2" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71b1c2-87bd578c7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-71b1c2-87bd578c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71b1c2: serviceaccount "payload-processing-e2e-autores-71b1c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-71b1c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-71b1c2-87bd578c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-71b1c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

openshift-ingress

kubelet

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.833s (2.833s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71b1c2-87bd578c7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

openshift-ingress

kubelet

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aa3ba758: serviceaccount "payload-processing-e2e-ait-aa3ba758" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-aa3ba758

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-aa3ba758-5c97ddbc7f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aa3ba758-584d877898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-aa3ba758-584d877898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aa3ba758: serviceaccount "payload-processing-e2e-ait-aa3ba758" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aa3ba758-584d877898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-aa3ba758

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-aa3ba758-584d877898 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-0d18cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0d18cc
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-0d18cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-0d18cc-openshift-default-55494b4f4b from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-0d18cc-openshift-default-55494b4f4b

SuccessfulCreate

Created pod: e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

ProbeError

Startup probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Unhealthy

Startup probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0d18cc-58c9876557

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-0d18cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-0d18cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-0d18cc-58c9876557 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-0d18cc-58c9876557

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-0d18cc-58c9876557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0d18cc: serviceaccount "payload-processing-e2e-inf-b-0d18cc" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0d18cc: serviceaccount "payload-processing-e2e-inf-b-0d18cc" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d
(x2)

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aa3ba758-584d877898-n4t8w

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-aa3ba758-openshift-default-8dcc96656-7dwhk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-aa3ba758-5c97ddbc7f-6gkfn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-0aacf4f7-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0aacf4f7-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0aacf4f7-gw

openshift-ingress

replicaset-controller

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd

SuccessfulCreate

Created pod: e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

openshift-ingress

multus

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0aacf4f7-5c6b548846

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0aacf4f7-5c6b548846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0aacf4f7: serviceaccount "payload-processing-e2e-migrate-0aacf4f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0aacf4f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0aacf4f7: serviceaccount "payload-processing-e2e-migrate-0aacf4f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0aacf4f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0aacf4f7-5c6b548846 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0aacf4f7-5c6b548846

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-0aacf4f7-5c6b548846-75v6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0aacf4f7-9c594c8fd-gd4rv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-1fc84f74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1fc84f74-openshift-default-c87c4b4cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-1fc84f74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1fc84f74

openshift-ingress

replicaset-controller

e2e-ait-1fc84f74-openshift-default-c87c4b4cd

SuccessfulCreate

Created pod: e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

openshift-ingress

multus

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-0aacf4f7-gw-openshift-default-84467fd4bd-55r44

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1fc84f74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1fc84f74-5bd6977565 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1fc84f74-5bd6977565

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1fc84f74-5bd6977565

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1fc84f74-5bd6977565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1fc84f74: serviceaccount "payload-processing-e2e-ait-1fc84f74" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1fc84f74: serviceaccount "payload-processing-e2e-ait-1fc84f74" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1fc84f74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1fc84f74-5bd6977565-6xkld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1fc84f74-78c9c94d58-ls4sv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-derive-f924630a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f924630a-openshift-default-785cd468cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-f924630a-openshift-default-785cd468cb

SuccessfulCreate

Created pod: e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

openshift-ingress

gateway_labeler_controller

e2e-derive-f924630a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f924630a

openshift-ingress

GatewayAuthBootstrap

e2e-derive-f924630a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-f924630a-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-f924630a-authn-ssl" already exists

openshift-ingress

kubelet

e2e-ait-1fc84f74-openshift-default-c87c4b4cd-m6kf6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f924630a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f924630a-8664f5bc45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f924630a-8664f5bc45

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f924630a: serviceaccount "payload-processing-e2e-derive-f924630a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f924630a-8664f5bc45

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f924630a-8664f5bc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f924630a: serviceaccount "payload-processing-e2e-derive-f924630a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f924630a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f924630a-6b5fb9cc94-l6twk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f924630a-8664f5bc45-d5nwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-f924630a-openshift-default-785cd468cb-srzbc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71b1c2-779c4c9b5d-w49w8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71b1c2-87bd578c7-gd5zg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-71b1c2-openshift-default-c85765c54-c4fl4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-54fc63-openshift-default-7cb4f74b48

SuccessfulCreate

Created pod: e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

openshift-ingress

deployment-controller

e2e-explicit-54fc63-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-54fc63-openshift-default-7cb4f74b48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-54fc63

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-54fc63

openshift-ingress

multus

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-54fc63

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-54fc63-c5fcc4b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-54fc63: serviceaccount "payload-processing-e2e-explicit-54fc63" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-54fc63

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-54fc63-5c7b85f594 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-54fc63-c5fcc4b5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-54fc63-c5fcc4b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-54fc63: serviceaccount "payload-processing-e2e-explicit-54fc63" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-54fc63-c5fcc4b5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-489fe7a4-openshift-default-5cb7645c76

SuccessfulCreate

Created pod: e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

openshift-ingress

deployment-controller

e2e-mt-489fe7a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-489fe7a4-openshift-default-5cb7645c76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-489fe7a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-489fe7a4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-489fe7a4: serviceaccount "payload-processing-e2e-mt-489fe7a4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

openshift-ingress

deployment-controller

payload-processing-e2e-mt-489fe7a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-489fe7a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-489fe7a4-645db94dc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-489fe7a4: serviceaccount "payload-processing-e2e-mt-489fe7a4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-489fe7a4-7fb6f6fc9c-4bvn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-489fe7a4-645db94dc4-mxw5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-489fe7a4-openshift-default-5cb7645c76-xbn7q

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-54fc63

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-54fc63: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-54fc63": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-54fc63, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e34288da-1a71-4267-a985-c43854250d64, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-54fc63-c5fcc4b5-9mcgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-54fc63-5c7b85f594-67ml8

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-93d67f-openshift-default-855c65d596

SuccessfulCreate

Created pod: e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

openshift-ingress

deployment-controller

e2e-shared-a-w2-93d67f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-93d67f-openshift-default-855c65d596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-93d67f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-93d67f

openshift-ingress

kubelet

e2e-explicit-54fc63-openshift-default-7cb4f74b48-bjwzv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-aab3a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-aab3a7

openshift-ingress

replicaset-controller

e2e-noten-aab3a7-openshift-default-54dfcd6f98

SuccessfulCreate

Created pod: e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

openshift-ingress

deployment-controller

e2e-noten-aab3a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-aab3a7-openshift-default-54dfcd6f98 from 0 to 1

openshift-ingress

kubelet

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-93d67f: serviceaccount "payload-processing-e2e-shared-a-w2-93d67f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-93d67f: serviceaccount "payload-processing-e2e-shared-a-w2-93d67f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-93d67f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-93d67f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-93d67f-8d49f645f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Unhealthy

Readiness probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

ProbeError

Readiness probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb

SuccessfulCreate

Created pod: e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

openshift-ingress

deployment-controller

e2e-shared-b-w2-e6454f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-e6454f-openshift-default-65d54878cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-e6454f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-e6454f
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e6454f: serviceaccount "payload-processing-e2e-shared-b-w2-e6454f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-e6454f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-e6454f-c586669f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e6454f-c586669f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e6454f-c586669f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-e6454f-c586669f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e6454f: serviceaccount "payload-processing-e2e-shared-b-w2-e6454f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-e6454f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-8d2ddf84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8d2ddf84-openshift-default-c45c5946d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-8d2ddf84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8d2ddf84

openshift-ingress

replicaset-controller

e2e-mt-8d2ddf84-openshift-default-c45c5946d

SuccessfulCreate

Created pod: e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8d2ddf84-857f47bb89

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8d2ddf84-857f47bb89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8d2ddf84: serviceaccount "payload-processing-e2e-mt-8d2ddf84" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8d2ddf84-857f47bb89

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

openshift-ingress

multus

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8d2ddf84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8d2ddf84: serviceaccount "payload-processing-e2e-mt-8d2ddf84" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8d2ddf84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8d2ddf84-857f47bb89 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-aab3a7-openshift-default-54dfcd6f98-h5q9c

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52b585-64f8d5854b-qmkrk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52b585-66df7776c-6r2hf

Unhealthy

Readiness probe failed: dial tcp 10.132.0.34:9004: i/o timeout

openshift-ingress

kubelet

e2e-inf-a-52b585-openshift-default-fbd66cf7b-8v4lj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-0d18cc-55645d8c54-dm66d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-0d18cc-58c9876557-6pnhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-ec9107

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-ec9107

openshift-ingress

deployment-controller

e2e-shared-a-w4-ec9107-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d

SuccessfulCreate

Created pod: e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

openshift-ingress

multus

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-0d18cc-openshift-default-55494b4f4b-cdzkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-ec9107: serviceaccount "payload-processing-e2e-shared-a-w4-ec9107" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-ec9107

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-ec9107-688cfd7599 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-ec9107

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-ec9107: serviceaccount "payload-processing-e2e-shared-a-w4-ec9107" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-d6c4cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-d6c4cc

openshift-ingress

replicaset-controller

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558

SuccessfulCreate

Created pod: e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

openshift-ingress

deployment-controller

e2e-shared-b-w4-d6c4cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-d6c4cc-openshift-default-f78b558 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-d6c4cc: serviceaccount "payload-processing-e2e-shared-b-w4-d6c4cc" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-d6c4cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-d6c4cc: serviceaccount "payload-processing-e2e-shared-b-w4-d6c4cc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-d6c4cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-8d2ddf84-857f47bb89-klgrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d2ddf84-867cc77f8-4xhr5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-8d2ddf84-openshift-default-c45c5946d-vcz9s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-6c4c23-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6c4c23-openshift-default-65dc9bfd7d from 0 to 1

openshift-ingress

multus

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d

SuccessfulCreate

Created pod: e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

openshift-ingress

gateway_labeler_controller

e2e-api-a-6c4c23

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6c4c23

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6c4c23-78cbb9945c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6c4c23

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6c4c23-66948bff5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6c4c23-78cbb9945c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6c4c23-78cbb9945c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6c4c23: serviceaccount "payload-processing-e2e-api-a-6c4c23" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6c4c23

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6c4c23-78cbb9945c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6c4c23: serviceaccount "payload-processing-e2e-api-a-6c4c23" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-999aa4-openshift-default-7756697448

SuccessfulCreate

Created pod: e2e-api-b-999aa4-openshift-default-7756697448-krdx4

openshift-ingress

gateway_labeler_controller

e2e-api-b-999aa4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-999aa4

openshift-ingress

deployment-controller

e2e-api-b-999aa4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-999aa4-openshift-default-7756697448 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-999aa4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-999aa4-8c5f8866c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-999aa4-8c5f8866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-999aa4: serviceaccount "payload-processing-e2e-api-b-999aa4" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-999aa4: serviceaccount "payload-processing-e2e-api-b-999aa4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-999aa4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-999aa4-8c5f8866c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-999aa4-8c5f8866c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b63ece-6f9b7fc4d6-w56fg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b63ece-78fbf6bfc5-pphmr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-b63ece

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-b63ece: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-b63ece": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-b63ece, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 801cdcc6-0c23-49d4-a9a4-0922f70af463, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w0-b63ece-openshift-default-7cf45974d4-t7dm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-6c4c23-78cbb9945c-xt25x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6c4c23-66948bff5d-b29bl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-6c4c23-openshift-default-65dc9bfd7d-94qrk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-999aa4-8c5f8866c-nkzk4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-999aa4-58b6bb66cd-f8ldd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-999aa4-openshift-default-7756697448-krdx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-93d67f-854d78b654-6zpx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-93d67f-8d49f645f-zkgr9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-93d67f-openshift-default-855c65d596-mp698

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c8b274-655b68d997-kslxz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c8b274-5dcc6f8678-lt7rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-c8b274-openshift-default-69b49d4d6b-5cs2f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e6454f-c586669f-2tr8p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e6454f-7db8597f8-dgpgq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-e6454f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e6454f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-e6454f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e6454f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1035d16c-6258-4268-a545-999f6bb961aa, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-e6454f-openshift-default-65d54878cb-6z7kb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-461acb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-461acb

openshift-ingress

deployment-controller

e2e-ipp-a-461acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-461acb-openshift-default-cd7cbd856 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-461acb-openshift-default-cd7cbd856

SuccessfulCreate

Created pod: e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

openshift-ingress

multus

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-461acb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-461acb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-461acb-85b9b74ff5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-461acb-85b9b74ff5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-461acb-85b9b74ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-461acb: serviceaccount "payload-processing-e2e-ipp-a-461acb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-461acb: serviceaccount "payload-processing-e2e-ipp-a-461acb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-461acb-85b9b74ff5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": read tcp 10.132.0.2:56236->10.132.0.73:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": read tcp 10.132.0.2:56236->10.132.0.73:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b01b33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b01b33

openshift-ingress

multus

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-b01b33-openshift-default-794bd6957d

SuccessfulCreate

Created pod: e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

openshift-ingress

deployment-controller

e2e-ipp-b-b01b33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b01b33-openshift-default-794bd6957d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b01b33: serviceaccount "payload-processing-e2e-ipp-b-b01b33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b01b33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b01b33-c775dff49 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b01b33-c775dff49

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b01b33-c775dff49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b01b33: serviceaccount "payload-processing-e2e-ipp-b-b01b33" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b01b33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b01b33-c775dff49

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d12501

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d12501

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d12501-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d12501

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d12501: serviceaccount "payload-processing-e2e-ipp-cleanup-d12501" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d12501: serviceaccount "payload-processing-e2e-ipp-cleanup-d12501" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d12501

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d12501-7776c98ffd-xhp4n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d12501-57748bbc7c-df92c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-d12501-openshift-default-67d64c4b78-kwx4s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-461acb-85b9b74ff5-6w5dk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-461acb-6d5dbddc8-gggpl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-461acb-openshift-default-cd7cbd856-6tsfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-b01b33

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-b01b33: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-b01b33": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-b01b33, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ee59921e-05d8-4ab7-8bdd-80c2115bd376, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b01b33-6cd94f5674-rhhsn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b01b33-c775dff49-crkrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-b01b33-openshift-default-794bd6957d-lp4sq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ec9107-688cfd7599-9twj7

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w4-ec9107

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w4-ec9107: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w4-ec9107": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w4-ec9107, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ecb4e02d-af84-4fa8-9d6a-eb6bafd41b49, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ec9107-65684fd498-smqzj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w4-ec9107-openshift-default-66c5f94f4d-cj6q2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-d6c4cc-6cf9f88fb9-mdftz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-d6c4cc-98fb9fcd-tskb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w4-d6c4cc-openshift-default-f78b558-7m6xn

Killing

Stopping container istio-proxy