Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2 to ip-10-0-135-253.ec2.internal

openshift-ingress

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k to ip-10-0-135-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-2qsjw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-2qsjw to ip-10-0-132-41.ec2.internal

openshift-ingress

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94 to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76 to ip-10-0-135-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-d64dz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-d64dz to ip-10-0-135-253.ec2.internal

openshift-ingress

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8 to ip-10-0-135-253.ec2.internal

openshift-ingress

kube-auth-proxy-f97b6d9fd-kq8jk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-f97b6d9fd-kq8jk to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp to ip-10-0-132-41.ec2.internal

openshift-ingress

kube-auth-proxy-f97b6d9fd-tl7dn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-f97b6d9fd-tl7dn to ip-10-0-135-253.ec2.internal

openshift-ingress

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-75688a34-openshift-default-6b457f876-6nnh8 to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-mt-157a333a-769d548657-7qn86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-157a333a-769d548657-7qn86 to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4 to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t to ip-10-0-135-253.ec2.internal

openshift-ingress

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Scheduled

Successfully assigned openshift-ingress/e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48 to ip-10-0-132-41.ec2.internal

openshift-ingress

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-75688a34-5659bd945f-xbnth to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7 to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-48de7216-cf4874f57-65d6c to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9 to ip-10-0-132-41.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4 to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8 to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj to ip-10-0-135-253.ec2.internal

openshift-ingress

router-default-847f74c87d-nnkct

Scheduled

Successfully assigned openshift-ingress/router-default-847f74c87d-nnkct to ip-10-0-135-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-chbcf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-chbcf to ip-10-0-135-253.ec2.internal

openshift-ingress

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Scheduled

Successfully assigned openshift-ingress/e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7 to ip-10-0-132-41.ec2.internal

openshift-ingress

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Scheduled

Successfully assigned openshift-ingress/e2e-autores-eef18d-openshift-default-5f67b8d696-9955f to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76 to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp to ip-10-0-132-41.ec2.internal

openshift-ingress

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Scheduled

Successfully assigned openshift-ingress/e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bsk8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bsk8t to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-zrd98

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-zrd98 to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn to ip-10-0-132-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f to ip-10-0-132-41.ec2.internal

openshift-ingress

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx to ip-10-0-135-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j to ip-10-0-130-195.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-847f74c87d from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x13)

openshift-ingress

replicaset-controller

router-default-847f74c87d

FailedCreate

Error creating: pods "router-default-847f74c87d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-847f74c87d

FailedCreate

Error creating: pods "router-default-847f74c87d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-847f74c87d

SuccessfulCreate

Created pod: router-default-847f74c87d-nnkct
(x5)

openshift-ingress

kubelet

router-default-847f74c87d-nnkct

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-847f74c87d-nnkct

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-847f74c87d-nnkct

Started

Started container router

openshift-ingress

kubelet

router-default-847f74c87d-nnkct

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-847f74c87d-nnkct

Created

Created container: router

openshift-ingress

multus

router-default-847f74c87d-nnkct

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-f97b6d9fd from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-f97b6d9fd

SuccessfulCreate

Created pod: kube-auth-proxy-f97b6d9fd-kq8jk

openshift-ingress

replicaset-controller

kube-auth-proxy-f97b6d9fd

SuccessfulCreate

Created pod: kube-auth-proxy-f97b6d9fd-tl7dn
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-f97b6d9fd

FailedCreate

Error creating: pods "kube-auth-proxy-f97b6d9fd-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-tl7dn

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-kq8jk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-tl7dn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-f97b6d9fd-tl7dn

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-f97b6d9fd-kq8jk

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-d64dz

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-d64dz

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-kq8jk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-kq8jk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-kq8jk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.011s (3.011s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-tl7dn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.528s (5.528s including waiting). Image size: 265120132 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-2qsjw

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-tl7dn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.642s (4.642s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-f97b6d9fd-tl7dn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2qsjw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-2qsjw

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2qsjw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2qsjw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2qsjw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.696s (2.696s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.907s (2.907s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-d64dz

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfsl4m

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-d64dz

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-chbcf

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-chbcf

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-zrd98

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bsk8t

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-zrd98

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsk8t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zrd98

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-bsk8t

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsk8t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.598s (1.598s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zrd98

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsk8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zrd98

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zrd98

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.681s (1.681s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsk8t

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-chbcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-chbcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-chbcf

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-chbcf

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-chbcf

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4f2d8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4f2d8a

openshift-ingress

deployment-controller

e2e-inf-a-fbc529-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-fbc529-openshift-default-576fc5c9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-fbc529-openshift-default-576fc5c9b

SuccessfulCreate

Created pod: e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

openshift-ingress

deployment-controller

e2e-worker-w0-1eec1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-1eec1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1eec1d

openshift-ingress

gateway_labeler_controller

e2e-inf-a-fbc529

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-fbc529

openshift-ingress

replicaset-controller

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4

SuccessfulCreate

Created pod: e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

openshift-ingress

multus

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-4f2d8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4

SuccessfulCreate

Created pod: e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

openshift-ingress

multus

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4f2d8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4f2d8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4f2d8a: serviceaccount "payload-processing-e2e-worker-w4-4f2d8a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4f2d8a: serviceaccount "payload-processing-e2e-worker-w4-4f2d8a" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-fbc529-74c64f9c9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-fbc529

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-fbc529-74c64f9c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-fbc529-74c64f9c9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-fbc529-74c64f9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-fbc529: serviceaccount "payload-processing-e2e-inf-a-fbc529" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-fbc529: serviceaccount "payload-processing-e2e-inf-a-fbc529" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-fbc529

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-eef18d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-eef18d-openshift-default-5f67b8d696 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-eef18d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-eef18d

openshift-ingress

multus

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-eef18d-openshift-default-5f67b8d696

SuccessfulCreate

Created pod: e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1eec1d: serviceaccount "payload-processing-e2e-worker-w0-1eec1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-1eec1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-1eec1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1eec1d: serviceaccount "payload-processing-e2e-worker-w0-1eec1d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

openshift-ingress

multus

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-75688a34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-75688a34

openshift-ingress

deployment-controller

e2e-ait-75688a34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-75688a34-openshift-default-6b457f876 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-75688a34-openshift-default-6b457f876

SuccessfulCreate

Created pod: e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

openshift-ingress

multus

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-eef18d-59f5bf98f5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-eef18d-59f5bf98f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-eef18d: serviceaccount "payload-processing-e2e-autores-eef18d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-eef18d-59f5bf98f5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-eef18d-86c9598f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-eef18d-86c9598f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-eef18d: serviceaccount "payload-processing-e2e-autores-eef18d" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-eef18d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-eef18d-86c9598f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-eef18d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-eef18d-59f5bf98f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-eef18d-86c9598f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

openshift-ingress

multus

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.629s (2.629s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-75688a34-5659bd945f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-75688a34-5659bd945f-xbnth
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-75688a34-5659bd945f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-75688a34-5659bd945f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-75688a34: serviceaccount "payload-processing-e2e-ait-75688a34" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-75688a34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-75688a34-5659bd945f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-75688a34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-75688a34-768467cf6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-75688a34-768467cf6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-75688a34-768467cf6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-75688a34-768467cf6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-75688a34: serviceaccount "payload-processing-e2e-ait-75688a34" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f22789

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f22789

openshift-ingress

replicaset-controller

e2e-inf-b-f22789-openshift-default-9c484d56d

SuccessfulCreate

Created pod: e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-f22789-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f22789-openshift-default-9c484d56d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f22789-559b7694db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f22789-559b7694db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f22789-559b7694db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f22789: serviceaccount "payload-processing-e2e-inf-b-f22789" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f22789

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f22789-559b7694db from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f22789-68d465879f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f22789-68d465879f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f22789: serviceaccount "payload-processing-e2e-inf-b-f22789" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f22789-68d465879f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f22789

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f22789-68d465879f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

Started

Started container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

Created

Created container: payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x8)

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-75688a34-768467cf6b-l2q5f

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-75688a34-5659bd945f-xbnth

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-75688a34-openshift-default-6b457f876-6nnh8

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-75688a34

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-75688a34: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-75688a34": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-75688a34, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2b226638-5229-4243-8c2e-790717abfd70, UID in object meta:

openshift-ingress

replicaset-controller

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb

SuccessfulCreate

Created pod: e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

openshift-ingress

gateway_labeler_controller

e2e-migrate-50cecd8f-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-50cecd8f-gw

openshift-ingress

deployment-controller

e2e-migrate-50cecd8f-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb from 0 to 1

openshift-ingress

multus

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-50cecd8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-50cecd8f-777b899db6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-50cecd8f-777b899db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-50cecd8f: serviceaccount "payload-processing-e2e-migrate-50cecd8f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-50cecd8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-50cecd8f-777b899db6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-50cecd8f: serviceaccount "payload-processing-e2e-migrate-50cecd8f" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-50cecd8f-777b899db6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

openshift-ingress

multus

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-50cecd8f-777b899db6-fx8nz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-50cecd8f-7fc88669c8-wxgll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-50cecd8f-gw-openshift-default-dockercfg-fp4zm); attempting to pull the image may not succeed.

openshift-ingress

deployment-controller

e2e-ait-48de7216-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-48de7216-openshift-default-848c856ffd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-48de7216

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-48de7216

openshift-ingress

GatewayAuthBootstrap

e2e-ait-48de7216

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-48de7216-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-48de7216-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-ait-48de7216-openshift-default-848c856ffd

SuccessfulCreate

Created pod: e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

openshift-ingress

multus

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-50cecd8f-gw-openshift-default-7854d459cb-4jldx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-48de7216

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-48de7216-fbc4c9874 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48de7216-fbc4c9874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48de7216-fbc4c9874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-48de7216-fbc4c9874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48de7216: serviceaccount "payload-processing-e2e-ait-48de7216" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-48de7216

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-48de7216-cf4874f57 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48de7216-cf4874f57

FailedCreate

Error creating: pods "payload-processing-e2e-ait-48de7216-cf4874f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48de7216: serviceaccount "payload-processing-e2e-ait-48de7216" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48de7216-cf4874f57

SuccessfulCreate

Created pod: payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48de7216-fbc4c9874-clh7p

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ait-48de7216

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ait-48de7216: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ait-48de7216": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ait-48de7216, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: df74661d-425b-4b1d-aec0-c794182ecaf7, UID in object meta:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-48de7216

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-48de7216: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-48de7216": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-48de7216, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aa6b4f10-bf6c-42f4-af7c-7dbf1fb0bbaa, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-48de7216-cf4874f57-65d6c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-48de7216-openshift-default-848c856ffd-mkkfj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-11860c1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-11860c1b-openshift-default-85fb9f5f44 from 0 to 1

openshift-ingress

multus

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-11860c1b-openshift-default-85fb9f5f44

SuccessfulCreate

Created pod: e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

openshift-ingress

gateway_labeler_controller

e2e-derive-11860c1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-11860c1b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-11860c1b: serviceaccount "payload-processing-e2e-derive-11860c1b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-11860c1b-64798c5db9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-11860c1b-64798c5db9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-11860c1b-64798c5db9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-11860c1b: serviceaccount "payload-processing-e2e-derive-11860c1b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-11860c1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-11860c1b-86f8cc9454 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-11860c1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-11860c1b-64798c5db9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eef18d-86c9598f4-sww48

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eef18d-59f5bf98f5-rdcm8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-11860c1b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-11860c1b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-11860c1b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-11860c1b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 667a8158-1f81-48a8-b2c5-174032ce6684, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-11860c1b-64798c5db9-9wn94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-11860c1b-86f8cc9454-n8psj

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-11860c1b-openshift-default-85fb9f5f44-7ljwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-eef18d-openshift-default-5f67b8d696-9955f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-b73e26-openshift-default-6dd9f46656

SuccessfulCreate

Created pod: e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

openshift-ingress

deployment-controller

e2e-explicit-b73e26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b73e26-openshift-default-6dd9f46656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-b73e26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b73e26

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.851s (2.851s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b73e26-7987d9b777

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b73e26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b73e26-79fd96485d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b73e26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b73e26-7987d9b777 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b73e26-79fd96485d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b73e26-79fd96485d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b73e26-79fd96485d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b73e26: serviceaccount "payload-processing-e2e-explicit-b73e26" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b73e26-7987d9b777

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b73e26-7987d9b777-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b73e26: serviceaccount "payload-processing-e2e-explicit-b73e26" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-eab152b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-eab152b6

openshift-ingress

deployment-controller

e2e-mt-eab152b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-eab152b6-openshift-default-c57fc98bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-eab152b6-openshift-default-c57fc98bd

SuccessfulCreate

Created pod: e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

openshift-ingress

multus

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-eab152b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-eab152b6-d866898cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-eab152b6-d866898cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-eab152b6: serviceaccount "payload-processing-e2e-mt-eab152b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-eab152b6-d866898cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

openshift-ingress

multus

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-eab152b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-eab152b6-d866898cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-eab152b6: serviceaccount "payload-processing-e2e-mt-eab152b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

openshift-ingress

kubelet

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b73e26-79fd96485d-2q6qm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b73e26-7987d9b777-z7wkx

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-noten-72547f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-72547f

openshift-ingress

deployment-controller

e2e-noten-72547f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-72547f-openshift-default-6ff497ddfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-72547f-openshift-default-6ff497ddfd

SuccessfulCreate

Created pod: e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

openshift-ingress

kubelet

e2e-explicit-b73e26-openshift-default-6dd9f46656-g6f9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eab152b6-6d85b7b7db-jnlgq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-eab152b6-d866898cc-fxsf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-eab152b6-openshift-default-c57fc98bd-d6gph

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-5b98dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976

SuccessfulCreate

Created pod: e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5b98dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5b98dc

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-5b98dc

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-5b98dc-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-5b98dc-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5b98dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5b98dc: serviceaccount "payload-processing-e2e-shared-a-w2-5b98dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5b98dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5b98dc: serviceaccount "payload-processing-e2e-shared-a-w2-5b98dc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5865ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5865ea

openshift-ingress

deployment-controller

e2e-shared-b-w2-5865ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5865ea-openshift-default-679dc84496 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5865ea-openshift-default-679dc84496

SuccessfulCreate

Created pod: e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-5865ea

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-5865ea-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-5865ea-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-72547f-openshift-default-6ff497ddfd-4zsnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5865ea: serviceaccount "payload-processing-e2e-shared-b-w2-5865ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5865ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5865ea: serviceaccount "payload-processing-e2e-shared-b-w2-5865ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5865ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5865ea-65d85487f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-157a333a-openshift-default-855fdd4668

SuccessfulCreate

Created pod: e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

openshift-ingress

deployment-controller

e2e-mt-157a333a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-157a333a-openshift-default-855fdd4668 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-157a333a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-157a333a

openshift-ingress

multus

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-157a333a-769d548657

FailedCreate

Error creating: pods "payload-processing-e2e-mt-157a333a-769d548657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-157a333a: serviceaccount "payload-processing-e2e-mt-157a333a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-157a333a: serviceaccount "payload-processing-e2e-mt-157a333a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-157a333a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-157a333a-7c6956fd5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-157a333a-769d548657

SuccessfulCreate

Created pod: payload-processing-e2e-mt-157a333a-769d548657-7qn86

openshift-ingress

deployment-controller

payload-processing-e2e-mt-157a333a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-157a333a-769d548657 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-157a333a-769d548657-7qn86

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-157a333a-769d548657-7qn86

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-157a333a-769d548657-7qn86

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-157a333a-769d548657-7qn86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fbc529-5cf5446bbb-4wnnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fbc529-74c64f9c9-47s7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-fbc529-openshift-default-576fc5c9b-7lq8t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f22789-68d465879f-2wnrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f22789-559b7694db-nzw6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6

SuccessfulCreate

Created pod: e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a75117

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a75117

openshift-ingress

multus

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-a75117-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-f22789-openshift-default-9c484d56d-qvnqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a75117: serviceaccount "payload-processing-e2e-shared-a-w3-a75117" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a75117: serviceaccount "payload-processing-e2e-shared-a-w3-a75117" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a75117

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a75117-57fdf4779f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a75117

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a75117-7447578cc4-9khgq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a75117-57fdf4779f-tn62r

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": read tcp 10.133.0.2:40622->10.133.0.80:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": read tcp 10.133.0.2:40622->10.133.0.80:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-11725e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-11725e

openshift-ingress

deployment-controller

e2e-shared-b-w3-11725e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd

SuccessfulCreate

Created pod: e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

openshift-ingress

multus

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a75117-openshift-default-6cb5f5cc6-ctxq8

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-11725e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-11725e: serviceaccount "payload-processing-e2e-shared-b-w3-11725e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-11725e: serviceaccount "payload-processing-e2e-shared-b-w3-11725e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-11725e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-11725e-5d5f859dbc-89r76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-11725e-65d548647d-nnkl9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-11725e-openshift-default-77f9ff9cbd-s6s76

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-157a333a-769d548657-7qn86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-157a333a-7c6956fd5d-zhws7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-157a333a-openshift-default-855fdd4668-2gq2p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-api-a-ac5968-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ac5968-openshift-default-846b9b8856 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ac5968

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ac5968

openshift-ingress

multus

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-ac5968-openshift-default-846b9b8856

SuccessfulCreate

Created pod: e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ac5968

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ac5968-fb68d4d5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ac5968

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ac5968-654df6f566 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ac5968-654df6f566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ac5968-654df6f566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ac5968: serviceaccount "payload-processing-e2e-api-a-ac5968" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ac5968-654df6f566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ac5968-fb68d4d5f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ac5968-fb68d4d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ac5968: serviceaccount "payload-processing-e2e-api-a-ac5968" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ac5968-fb68d4d5f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-api-b-9eae22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9eae22

openshift-ingress

replicaset-controller

e2e-api-b-9eae22-openshift-default-78548b7f46

SuccessfulCreate

Created pod: e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-9eae22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9eae22-openshift-default-78548b7f46 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9eae22: serviceaccount "payload-processing-e2e-api-b-9eae22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9eae22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9eae22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9eae22-67c578b589 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9eae22-67c578b589

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9eae22-67c578b589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9eae22: serviceaccount "payload-processing-e2e-api-b-9eae22" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9eae22-67c578b589

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

openshift-ingress

multus

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ac5968-654df6f566-8579j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ac5968-fb68d4d5f-4qgfl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-ac5968-openshift-default-846b9b8856-cxxnx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-9eae22-67c578b589-gwmpl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9eae22-bfc97b5cd-bxtst

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9eae22-openshift-default-78548b7f46-4mwf2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5b98dc-85d9f6d54b-vqhqv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5b98dc-684dfb7f5f-5s55t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-5b98dc-openshift-default-7d5d44d976-fr42z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5865ea-fb7d99446-hxpxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5865ea-65d85487f9-spjz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1eec1d-7799cc4d5c-hkwfp

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-1eec1d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-1eec1d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-1eec1d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-1eec1d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8f993e59-1156-4fef-b304-55d9159fe790, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1eec1d-7b7c957878-zpmtq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-5865ea-openshift-default-679dc84496-xwlgq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-1eec1d-openshift-default-f7cf48dc4-bn8lw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4f2d8a-6f66d947b9-kq5k4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4f2d8a-5fff85c574-6w7zp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-4f2d8a-openshift-default-69bf5668c4-dzj8k

Killing

Stopping container istio-proxy

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer