Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7 to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd to ip-10-0-132-170.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-7v444

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7v444 to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2 to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-5bqf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-5bqf9 to ip-10-0-143-220.ec2.internal

openshift-ingress

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c to ip-10-0-143-220.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zc7qw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zc7qw to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89 to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f to ip-10-0-143-220.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-pq4hx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pq4hx to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq to ip-10-0-143-220.ec2.internal

openshift-ingress

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65 to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j to ip-10-0-132-170.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-f6jfs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f6jfs to ip-10-0-143-220.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268 to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg to ip-10-0-142-145.ec2.internal

openshift-ingress

kube-auth-proxy-57dff8dc5-xn758

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-57dff8dc5-xn758 to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz to ip-10-0-132-170.ec2.internal

openshift-ingress

router-default-7b5c4b4df6-24w55

Scheduled

Successfully assigned openshift-ingress/router-default-7b5c4b4df6-24w55 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2 to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4 to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-49887c13-564db6d8df-98tpc to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f to ip-10-0-142-145.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5 to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82 to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58 to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9 to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd to ip-10-0-132-170.ec2.internal

openshift-ingress

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc to ip-10-0-132-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4 to ip-10-0-142-145.ec2.internal

openshift-ingress

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv to ip-10-0-142-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96 to ip-10-0-132-170.ec2.internal

openshift-ingress

kube-auth-proxy-57dff8dc5-hjn5h

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-57dff8dc5-hjn5h to ip-10-0-143-220.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7b5c4b4df6 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-7b5c4b4df6

FailedCreate

Error creating: pods "router-default-7b5c4b4df6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7b5c4b4df6

FailedCreate

Error creating: pods "router-default-7b5c4b4df6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7b5c4b4df6

SuccessfulCreate

Created pod: router-default-7b5c4b4df6-24w55
(x6)

openshift-ingress

kubelet

router-default-7b5c4b4df6-24w55

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7b5c4b4df6-24w55

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7b5c4b4df6-24w55

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7b5c4b4df6-24w55

Started

Started container router

openshift-ingress

kubelet

router-default-7b5c4b4df6-24w55

Created

Created container: router

openshift-ingress

kubelet

router-default-7b5c4b4df6-24w55

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-57dff8dc5

SuccessfulCreate

Created pod: kube-auth-proxy-57dff8dc5-xn758

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-57dff8dc5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-57dff8dc5

SuccessfulCreate

Created pod: kube-auth-proxy-57dff8dc5-hjn5h
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-57dff8dc5

FailedCreate

Error creating: pods "kube-auth-proxy-57dff8dc5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-57dff8dc5-xn758

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-57dff8dc5-hjn5h

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-xn758

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-hjn5h

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-f6jfs

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-f6jfs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-xn758

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-xn758

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-xn758

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.733s (2.733s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-hjn5h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.79s (2.79s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-hjn5h

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57dff8dc5-hjn5h

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.974s (2.974s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rsnd5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.819s (2.819s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zc7qw

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zc7qw

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.324s (2.324s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zc7qw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f6jfs

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-f6jfs

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-7v444

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-7v444

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pq4hx

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-5bqf9

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5bqf9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-5bqf9

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-pq4hx

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pq4hx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5bqf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5bqf9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.705s (1.705s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pq4hx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5bqf9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pq4hx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pq4hx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.151s (2.151s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7v444

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7v444

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7v444

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7v444

Unhealthy

Startup probe failed: Get "http://10.132.0.23:15021/healthz/ready": dial tcp 10.132.0.23:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7v444

ProbeError

Startup probe error: Get "http://10.132.0.23:15021/healthz/ready": dial tcp 10.132.0.23:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-cbc380

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-cbc380

openshift-ingress

deployment-controller

e2e-inf-a-cbc380-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-cbc380-openshift-default-74d656dc84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-cbc380-openshift-default-74d656dc84

SuccessfulCreate

Created pod: e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

openshift-ingress

multus

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-cbc380: serviceaccount "payload-processing-e2e-inf-a-cbc380" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-cbc380

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-cbc380-d9ccbfcb7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-cbc380: serviceaccount "payload-processing-e2e-inf-a-cbc380" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-cbc380

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

openshift-ingress

gateway_labeler_controller

e2e-autores-cdec04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-cdec04

openshift-ingress

deployment-controller

e2e-autores-cdec04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-cdec04-openshift-default-76fcf7b4bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-cdec04-openshift-default-76fcf7b4bd

SuccessfulCreate

Created pod: e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.853s (2.853s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-49887c13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-49887c13

openshift-ingress

multus

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-49887c13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-49887c13-openshift-default-785654ccb6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-49887c13-openshift-default-785654ccb6

SuccessfulCreate

Created pod: e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.915s (2.915s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-cdec04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-cdec04-9d9dd46d6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-cdec04-5cf4975955

FailedCreate

Error creating: pods "payload-processing-e2e-autores-cdec04-5cf4975955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cdec04: serviceaccount "payload-processing-e2e-autores-cdec04" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-cdec04-5cf4975955

SuccessfulCreate

Created pod: payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

openshift-ingress

deployment-controller

payload-processing-e2e-autores-cdec04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-cdec04-5cf4975955 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cdec04: serviceaccount "payload-processing-e2e-autores-cdec04" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

openshift-ingress

multus

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-49887c13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-49887c13-564db6d8df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-49887c13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-49887c13-79dd6cfd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-49887c13-564db6d8df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-49887c13: serviceaccount "payload-processing-e2e-ait-49887c13" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

openshift-ingress

kubelet

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-49887c13-564db6d8df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-49887c13-564db6d8df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-49887c13: serviceaccount "payload-processing-e2e-ait-49887c13" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Unhealthy

Readiness probe failed: Get "http://10.132.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

ProbeError

Readiness probe error: Get "http://10.132.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

ProbeError

Startup probe error: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Unhealthy

Startup probe failed: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

ProbeError

Readiness probe error: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Unhealthy

Readiness probe failed: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-12d2a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-12d2a9

openshift-ingress

deployment-controller

e2e-inf-b-12d2a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-12d2a9-openshift-default-5844c946c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-12d2a9-openshift-default-5844c946c4

SuccessfulCreate

Created pod: e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

openshift-ingress

multus

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x5)

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 6.006s (6.006s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-12d2a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-12d2a9-595d58c794 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-12d2a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-12d2a9-5944db5cd9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12d2a9-5944db5cd9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-12d2a9-5944db5cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12d2a9: serviceaccount "payload-processing-e2e-inf-b-12d2a9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12d2a9-5944db5cd9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12d2a9: serviceaccount "payload-processing-e2e-inf-b-12d2a9" not found
(x6)

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-49887c13-564db6d8df-98tpc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-49887c13-79dd6cfd6-rzd96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-migrate-150d6af2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-150d6af2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-150d6af2-gw

openshift-ingress

replicaset-controller

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48

SuccessfulCreate

Created pod: e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

openshift-ingress

multus

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-49887c13-openshift-default-785654ccb6-qqg9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-150d6af2-9d78f58cd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-150d6af2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-150d6af2-9d78f58cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-150d6af2-9d78f58cd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-150d6af2-9d78f58cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-150d6af2: serviceaccount "payload-processing-e2e-migrate-150d6af2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-150d6af2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-150d6af2-7f5946564b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-150d6af2: serviceaccount "payload-processing-e2e-migrate-150d6af2" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:45022->10.134.0.41:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": read tcp 10.134.0.2:45022->10.134.0.41:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-150d6af2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-150d6af2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-150d6af2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-150d6af2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3009c2a1-74b2-4c33-81b9-448917ee1a87, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-150d6af2-7f5946564b-9j7mr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-150d6af2-9d78f58cd-r4lqf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-087015a2-openshift-default-76dfdf794d

SuccessfulCreate

Created pod: e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

openshift-ingress

deployment-controller

e2e-ait-087015a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-087015a2-openshift-default-76dfdf794d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-087015a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-087015a2

openshift-ingress

multus

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-migrate-150d6af2-gw-openshift-default-6cbd88b48-wkkjs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-087015a2-7456664d5f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

openshift-ingress

multus

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-087015a2-6f994cd498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-087015a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-087015a2-6f994cd498 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-087015a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-087015a2-7456664d5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-087015a2-7456664d5f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-087015a2-7456664d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-087015a2: serviceaccount "payload-processing-e2e-ait-087015a2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-087015a2-6f994cd498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-087015a2-6f994cd498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-087015a2: serviceaccount "payload-processing-e2e-ait-087015a2" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-087015a2-7456664d5f-mjjnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-087015a2-6f994cd498-8lfmb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-087015a2-openshift-default-76dfdf794d-xttfd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-cdec04-5cf4975955-bhc9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cdec04-9d9dd46d6-4cx82

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd

SuccessfulCreate

Created pod: e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

openshift-ingress

deployment-controller

e2e-derive-0eb76ba5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0eb76ba5-openshift-default-c4fc88bdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-0eb76ba5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0eb76ba5

openshift-ingress

multus

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0eb76ba5-d9d447497

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0eb76ba5-d9d447497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0eb76ba5: serviceaccount "payload-processing-e2e-derive-0eb76ba5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0eb76ba5-d9d447497

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0eb76ba5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0eb76ba5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0eb76ba5-d9d447497 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0eb76ba5: serviceaccount "payload-processing-e2e-derive-0eb76ba5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

openshift-ingress

multus

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-cdec04-openshift-default-76fcf7b4bd-42jwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0eb76ba5-785cb7b9b6-c4g2f

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-explicit-69b1ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-69b1ea-openshift-default-57858dbb96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-69b1ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-69b1ea

openshift-ingress

kubelet

payload-processing-e2e-derive-0eb76ba5-d9d447497-hc85x

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-explicit-69b1ea-openshift-default-57858dbb96

SuccessfulCreate

Created pod: e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-0eb76ba5-openshift-default-c4fc88bdd-vm268

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-69b1ea-74dd4478d5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-69b1ea: serviceaccount "payload-processing-e2e-explicit-69b1ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-69b1ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-69b1ea-74dd4478d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-69b1ea-74dd4478d5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-69b1ea-74dd4478d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-69b1ea: serviceaccount "payload-processing-e2e-explicit-69b1ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-69b1ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-69b1ea-7bf7698f94-wg896

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-69b1ea-74dd4478d5-qdt5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-69b1ea-openshift-default-57858dbb96-ntl89

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-noten-4a674b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4a674b-openshift-default-5dcc666664 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-4a674b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4a674b

openshift-ingress

replicaset-controller

e2e-noten-4a674b-openshift-default-5dcc666664

SuccessfulCreate

Created pod: e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

openshift-ingress

kubelet

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-4a674b-openshift-default-5dcc666664-w7bq6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-24cfea9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-24cfea9d

openshift-ingress

replicaset-controller

e2e-mt-24cfea9d-openshift-default-b56fdd8c6

SuccessfulCreate

Created pod: e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

openshift-ingress

deployment-controller

e2e-mt-24cfea9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-24cfea9d-openshift-default-b56fdd8c6 from 0 to 1

openshift-ingress

multus

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cbc380-7b4d557d8b-52rrl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cbc380-d9ccbfcb7-zrzjq

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-24cfea9d: serviceaccount "payload-processing-e2e-mt-24cfea9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-24cfea9d-5dff57b685

SuccessfulCreate

Created pod: payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-24cfea9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-24cfea9d-5dff57b685 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-24cfea9d-5dff57b685

FailedCreate

Error creating: pods "payload-processing-e2e-mt-24cfea9d-5dff57b685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-24cfea9d: serviceaccount "payload-processing-e2e-mt-24cfea9d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-24cfea9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-cbc380-openshift-default-74d656dc84-hcxg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12d2a9-5944db5cd9-4wrcl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-12d2a9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-12d2a9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-12d2a9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-12d2a9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 42517505-4320-431e-ae15-bfc63827e9cd, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12d2a9-595d58c794-xs4gq

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-12d2a9-openshift-default-5844c946c4-8sblv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-af081c-openshift-default-547c47967d

SuccessfulCreate

Created pod: e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-af081c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-af081c

openshift-ingress

deployment-controller

e2e-shared-a-w3-af081c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-af081c-openshift-default-547c47967d from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-af081c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-af081c: serviceaccount "payload-processing-e2e-shared-a-w3-af081c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-af081c: serviceaccount "payload-processing-e2e-shared-a-w3-af081c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-af081c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-af081c-74b8976d5c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-24cfea9d-5dff57b685-lvzz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24cfea9d-7b69fc9c8b-bh8ds

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:60356->10.132.0.42:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:60356->10.132.0.42:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-24cfea9d-openshift-default-b56fdd8c6-276g9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4

SuccessfulCreate

Created pod: e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

openshift-ingress

deployment-controller

e2e-shared-b-w3-d844cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-d844cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-d844cc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d844cc: serviceaccount "payload-processing-e2e-shared-b-w3-d844cc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-d844cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-d844cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d844cc: serviceaccount "payload-processing-e2e-shared-b-w3-d844cc" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-shared-a-w2-45352b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-45352b-openshift-default-58896f9cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-45352b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-45352b

openshift-ingress

replicaset-controller

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8

SuccessfulCreate

Created pod: e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

openshift-ingress

multus

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-45352b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-45352b-795454fb55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-45352b: serviceaccount "payload-processing-e2e-shared-a-w2-45352b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-45352b-795454fb55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-45352b-795454fb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-45352b: serviceaccount "payload-processing-e2e-shared-a-w2-45352b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-45352b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-45352b-795454fb55 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:57774->10.134.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:57774->10.134.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:59672->10.134.0.58:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:59672->10.134.0.58:15021: read: connection reset by peer body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f7851b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f7851b

openshift-ingress

deployment-controller

e2e-shared-b-w2-f7851b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd

SuccessfulCreate

Created pod: e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

openshift-ingress

multus

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f7851b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f7851b-576c644c89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f7851b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7851b-576c644c89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f7851b-576c644c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7851b: serviceaccount "payload-processing-e2e-shared-b-w2-f7851b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7851b: serviceaccount "payload-processing-e2e-shared-b-w2-f7851b" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7851b-576c644c89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-8d375e02-openshift-default-5c5df7598d

SuccessfulCreate

Created pod: e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

openshift-ingress

deployment-controller

e2e-mt-8d375e02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8d375e02-openshift-default-5c5df7598d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-8d375e02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8d375e02

openshift-ingress

multus

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8d375e02-79c6f95b97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8d375e02-79c6f95b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8d375e02: serviceaccount "payload-processing-e2e-mt-8d375e02" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8d375e02-99f8c946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8d375e02-99f8c946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8d375e02: serviceaccount "payload-processing-e2e-mt-8d375e02" not found

openshift-ingress

multus

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8d375e02-99f8c946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8d375e02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8d375e02-99f8c946 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8d375e02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8d375e02-79c6f95b97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8d375e02-79c6f95b97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2
(x2)

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-8d375e02

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-8d375e02: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-8d375e02": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-8d375e02, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2320a2e-cde7-41d7-8e9a-329a27bd9bd9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8d375e02-99f8c946-tvcq6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8d375e02-79c6f95b97-bdbf2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-8d375e02-openshift-default-5c5df7598d-wn7xl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-fb3c56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fb3c56

openshift-ingress

deployment-controller

e2e-api-a-fb3c56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-fb3c56-openshift-default-56649fbddb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-fb3c56-openshift-default-56649fbddb

SuccessfulCreate

Created pod: e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

openshift-ingress

multus

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-fb3c56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-fb3c56-7866c89c49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-fb3c56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fb3c56: serviceaccount "payload-processing-e2e-api-a-fb3c56" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fb3c56-7866c89c49

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fb3c56-7866c89c49

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-fb3c56-7866c89c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fb3c56: serviceaccount "payload-processing-e2e-api-a-fb3c56" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

openshift-ingress

kubelet

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-e2e-api-a-fb3c56-dockercfg-6qfzk); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-f4d189-openshift-default-596bf75ffd

SuccessfulCreate

Created pod: e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

openshift-ingress

deployment-controller

e2e-api-b-f4d189-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f4d189-openshift-default-596bf75ffd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f4d189

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f4d189

openshift-ingress

multus

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f4d189-674956cf6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f4d189-674956cf6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f4d189-674956cf6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f4d189: serviceaccount "payload-processing-e2e-api-b-f4d189" not found

openshift-ingress

multus

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f4d189-86bd5948b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

openshift-ingress

kubelet

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f4d189-86bd5948b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f4d189-86bd5948b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f4d189: serviceaccount "payload-processing-e2e-api-b-f4d189" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f4d189

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f4d189-86bd5948b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f4d189

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f4d189-674956cf6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-fb3c56-7866c89c49-4jckp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fb3c56-d8c7bd578-l7nz4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-fb3c56

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-fb3c56: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-fb3c56": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-fb3c56, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 468d0545-b542-479f-b5dd-49691685f945, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-fb3c56-openshift-default-56649fbddb-5g6mg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d

SuccessfulCreate

Created pod: e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

openshift-ingress

deployment-controller

e2e-ipp-a-bf9d5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bf9d5c-openshift-default-696d77f94d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bf9d5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bf9d5c

openshift-ingress

multus

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f4d189-86bd5948b9-92cgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f4d189-674956cf6b-lkpgd

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bf9d5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bf9d5c-7c46789f87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9d5c: serviceaccount "payload-processing-e2e-ipp-a-bf9d5c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bf9d5c: serviceaccount "payload-processing-e2e-ipp-a-bf9d5c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bf9d5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-b-f4d189-openshift-default-596bf75ffd-fjjhx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-45352b-5ddc97f6c8-tv8dc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-45352b-795454fb55-wh6kd

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-45352b-openshift-default-58896f9cb8-ljlp6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d

SuccessfulCreate

Created pod: e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-986cf2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-986cf2

openshift-ingress

deployment-controller

e2e-ipp-b-986cf2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d from 0 to 1

openshift-ingress

multus

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-986cf2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-986cf2-65674c9d59

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-986cf2-65674c9d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-986cf2: serviceaccount "payload-processing-e2e-ipp-b-986cf2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-986cf2-65674c9d59

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-986cf2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-986cf2-65674c9d59 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-986cf2: serviceaccount "payload-processing-e2e-ipp-b-986cf2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7851b-576c644c89-nbcgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7851b-69678bc8b6-rg8fq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-f7851b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f7851b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-f7851b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f7851b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 99b0bb7c-52df-4d86-bb8a-95d96a5ff226, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-f7851b-openshift-default-6f6578d9cd-zwb58

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5c1bd9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5c1bd9

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5c1bd9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5c1bd9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5c1bd9: serviceaccount "payload-processing-e2e-ipp-cleanup-5c1bd9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5c1bd9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5c1bd9: serviceaccount "payload-processing-e2e-ipp-cleanup-5c1bd9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5c1bd9-57bd5c67cd-9knwh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5c1bd9-6c468fdb4c-g7qfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-5c1bd9-openshift-default-f76fc9c56-f9wgq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bf9d5c-7c46789f87-94c7j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bf9d5c-5bc4c96fdb-fjvpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-bf9d5c-openshift-default-696d77f94d-p77v4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-986cf2-57cd48794b-t8qcx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-986cf2-65674c9d59-q6f47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-986cf2-openshift-default-77c6cd5f8d-nstr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-af081c-74b8976d5c-tvm6b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-af081c-56499d888b-pg28q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-af081c-openshift-default-547c47967d-b6qcz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d844cc-6c8446bb85-frh5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d844cc-cc8b44746-lzlgq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-d844cc-openshift-default-d787c6bf4-zkk65

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503