Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r to ip-10-0-130-192.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws to ip-10-0-130-192.ec2.internal

openshift-ingress

kube-auth-proxy-cd8d54847-5d6sk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-cd8d54847-5d6sk to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt to ip-10-0-140-211.ec2.internal

openshift-ingress

kube-auth-proxy-cd8d54847-5tts4

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-cd8d54847-5tts4 to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

Scheduled

Successfully assigned openshift-ingress/e2e-noten-21de0f-openshift-default-5d987c799b-crn5h to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2 to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5 to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-p7hvp

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-p7hvp to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5 to ip-10-0-128-196.ec2.internal

openshift-ingress

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7 to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689 to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4 to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5a30bd

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.180.82 is not allocated; repairing

openshift-ingress

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd to ip-10-0-140-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cwlcv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cwlcv to ip-10-0-130-192.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fg5pc to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4 to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p to ip-10-0-140-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-l65sg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l65sg to ip-10-0-128-196.ec2.internal

openshift-ingress

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ttz9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ttz9p to ip-10-0-128-196.ec2.internal

openshift-ingress

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64 to ip-10-0-130-192.ec2.internal

openshift-ingress

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv to ip-10-0-128-196.ec2.internal

openshift-ingress

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt to ip-10-0-130-192.ec2.internal

openshift-ingress

router-default-596c47f5b-6k94l

Scheduled

Successfully assigned openshift-ingress/router-default-596c47f5b-6k94l to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0d892491-7c4995f89-69t76 to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87 to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt to ip-10-0-128-196.ec2.internal

openshift-ingress

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82 to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7 to ip-10-0-128-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5 to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0d892491-openshift-default-6b85768f6-svzpr to ip-10-0-130-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb to ip-10-0-128-196.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-596c47f5b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-596c47f5b

FailedCreate

Error creating: pods "router-default-596c47f5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-596c47f5b

FailedCreate

Error creating: pods "router-default-596c47f5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-596c47f5b

SuccessfulCreate

Created pod: router-default-596c47f5b-6k94l
(x6)

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

Started

Started container router

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

Created

Created container: router

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-596c47f5b-6k94l

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [-]has-synced failed: reason withheld [+]process-running ok healthz check failed
(x3)

openshift-ingress

kubelet

router-default-596c47f5b-6k94l

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5d6sk

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-cd8d54847 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5tts4

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-cd8d54847

FailedCreate

Error creating: pods "kube-auth-proxy-cd8d54847-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-cd8d54847

SuccessfulCreate

Created pod: kube-auth-proxy-cd8d54847-5tts4

openshift-ingress

replicaset-controller

kube-auth-proxy-cd8d54847

SuccessfulCreate

Created pod: kube-auth-proxy-cd8d54847-5d6sk

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-l65sg

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5tts4

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-cd8d54847-5tts4

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5d6sk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-cd8d54847-5d6sk

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-l65sg

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5d6sk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5tts4

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5d6sk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5d6sk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.599s (2.599s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5tts4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.73s (2.73s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-cd8d54847-5tts4

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.457s (3.457s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Created

Created container: discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.381s (2.381s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kksws

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cwlcv

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cwlcv

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.234s (2.234s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cwlcv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

ProbeError

Readiness probe error: Get "http://10.132.0.18:8080/ready": dial tcp 10.132.0.18:8080: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-l65sg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-l65sg

Unhealthy

Readiness probe failed: Get "http://10.132.0.18:8080/ready": dial tcp 10.132.0.18:8080: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-fg5pc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-p7hvp

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ttz9p

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ttz9p

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-p7hvp

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p7hvp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ttz9p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p7hvp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.559s (1.559s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p7hvp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p7hvp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ttz9p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.731s (2.731s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ttz9p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ttz9p

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fg5pc

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-76b274

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-76b274

openshift-ingress

deployment-controller

e2e-inf-a-76b274-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-76b274-openshift-default-5d877c9fdb from 0 to 1

openshift-ingress

multus

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-76b274-openshift-default-5d877c9fdb

SuccessfulCreate

Created pod: e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-76b274

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-76b274-6f96f68b78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-76b274: serviceaccount "payload-processing-e2e-inf-a-76b274" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-76b274-6b8b989b8f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-76b274-6b8b989b8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-76b274: serviceaccount "payload-processing-e2e-inf-a-76b274" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-76b274-6b8b989b8f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-76b274

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-76b274-6b8b989b8f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864

SuccessfulCreate

Created pod: e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

openshift-ingress

multus

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-d9fd5e6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d9fd5e6e-openshift-default-86dfb5f864 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-d9fd5e6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d9fd5e6e

openshift-ingress

gateway_labeler_controller

e2e-autores-f96a7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f96a7a

openshift-ingress

deployment-controller

e2e-autores-f96a7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f96a7a-openshift-default-747d475c7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-f96a7a-openshift-default-747d475c7d

SuccessfulCreate

Created pod: e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

openshift-ingress

multus

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d9fd5e6e: serviceaccount "payload-processing-e2e-ait-d9fd5e6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d9fd5e6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d9fd5e6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d9fd5e6e-576859c5d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d9fd5e6e-576859c5d7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d9fd5e6e-576859c5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d9fd5e6e: serviceaccount "payload-processing-e2e-ait-d9fd5e6e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d9fd5e6e-576859c5d7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

openshift-ingress

kubelet

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f96a7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f96a7a-747fb78bfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f96a7a-884d47dbf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f96a7a-884d47dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f96a7a: serviceaccount "payload-processing-e2e-autores-f96a7a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f96a7a-884d47dbf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f96a7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f96a7a-884d47dbf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f96a7a: serviceaccount "payload-processing-e2e-autores-f96a7a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:44602->10.133.0.37:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:44602->10.133.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-31e7cb-openshift-default-79bb4c5598

SuccessfulCreate

Created pod: e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

openshift-ingress

deployment-controller

e2e-inf-b-31e7cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-31e7cb-openshift-default-79bb4c5598 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-31e7cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-31e7cb

openshift-ingress

multus

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-31e7cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-31e7cb-c7b9bf57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-31e7cb-c7b9bf57

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-31e7cb-c7b9bf57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-31e7cb: serviceaccount "payload-processing-e2e-inf-b-31e7cb" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-31e7cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-31e7cb-595db48894 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-31e7cb-595db48894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-31e7cb-595db48894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-31e7cb-595db48894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-31e7cb: serviceaccount "payload-processing-e2e-inf-b-31e7cb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-31e7cb-c7b9bf57

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9fd5e6e-79f7d56ddb-t2h4r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d9fd5e6e-576859c5d7-b545j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4

SuccessfulCreate

Created pod: e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

openshift-ingress

gateway_labeler_controller

e2e-migrate-bbddbd71-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-bbddbd71-gw

openshift-ingress

multus

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-bbddbd71-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4 from 0 to 1

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-d9fd5e6e-openshift-default-86dfb5f864-lqmhk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-bbddbd71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bbddbd71: serviceaccount "payload-processing-e2e-migrate-bbddbd71" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-bbddbd71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-bbddbd71-5947799886 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bbddbd71-5947799886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-bbddbd71-5947799886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-bbddbd71-5947799886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-bbddbd71: serviceaccount "payload-processing-e2e-migrate-bbddbd71" not found

openshift-ingress

multus

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-bbddbd71-5947799886-2skb7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-bbddbd71-gw-openshift-default-6888544fd4-lst64

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-bbddbd71-6cd5b4f84b-pfd4g

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-bbddbd71

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-bbddbd71: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-bbddbd71": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-bbddbd71, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 74d2a831-8fae-4fb2-bb78-806be4ae3a31, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-ait-e95f46e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e95f46e9

openshift-ingress

multus

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e95f46e9-openshift-default-78988fdcd6

SuccessfulCreate

Created pod: e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

openshift-ingress

deployment-controller

e2e-ait-e95f46e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e95f46e9-openshift-default-78988fdcd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e95f46e9: serviceaccount "payload-processing-e2e-ait-e95f46e9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e95f46e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e95f46e9-58cf866c54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e95f46e9-687b6bf445

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e95f46e9-687b6bf445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e95f46e9: serviceaccount "payload-processing-e2e-ait-e95f46e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e95f46e9-687b6bf445

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e95f46e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e95f46e9-687b6bf445 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

openshift-ingress

kubelet

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e95f46e9-58cf866c54-57jzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e95f46e9-687b6bf445-d6vp8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e95f46e9-openshift-default-78988fdcd6-6cczv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0d892491

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0d892491

openshift-ingress

multus

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-0d892491-openshift-default-6b85768f6

SuccessfulCreate

Created pod: e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

openshift-ingress

deployment-controller

e2e-derive-0d892491-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0d892491-openshift-default-6b85768f6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0d892491-665759ffd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0d892491-665759ffd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0d892491: serviceaccount "payload-processing-e2e-derive-0d892491" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0d892491-665759ffd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0d892491

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0d892491-665759ffd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0d892491

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0d892491-7c4995f89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0d892491-7c4995f89

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0d892491-7c4995f89-69t76
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0d892491-7c4995f89

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0d892491-7c4995f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0d892491: serviceaccount "payload-processing-e2e-derive-0d892491" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-f96a7a-884d47dbf-vd7f4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f96a7a-747fb78bfd-bcw98

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d892491-665759ffd6-qpsq5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0d892491-7c4995f89-69t76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-0d892491-openshift-default-6b85768f6-svzpr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-ea71f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ea71f9

openshift-ingress

deployment-controller

e2e-explicit-ea71f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ea71f9-openshift-default-585cb6ddbd from 0 to 1

openshift-ingress

kubelet

e2e-autores-f96a7a-openshift-default-747d475c7d-gx9bp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-ea71f9-openshift-default-585cb6ddbd

SuccessfulCreate

Created pod: e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

openshift-ingress

multus

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ea71f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ea71f9-6db85bccd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ea71f9-8ffbcf597

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ea71f9-8ffbcf597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ea71f9: serviceaccount "payload-processing-e2e-explicit-ea71f9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ea71f9: serviceaccount "payload-processing-e2e-explicit-ea71f9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ea71f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ea71f9-8ffbcf597 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ea71f9-8ffbcf597

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea71f9-8ffbcf597-2vx87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea71f9-6db85bccd-gjqtx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-ea71f9-openshift-default-585cb6ddbd-h4shj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-21de0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-21de0f

openshift-ingress

kubelet

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-21de0f-openshift-default-5d987c799b

SuccessfulCreate

Created pod: e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

openshift-ingress

kubelet

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-21de0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-21de0f-openshift-default-5d987c799b from 0 to 1

openshift-ingress

kubelet

e2e-noten-21de0f-openshift-default-5d987c799b-crn5h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-c6e2e41d-openshift-default-74bf689784

SuccessfulCreate

Created pod: e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

openshift-ingress

gateway_labeler_controller

e2e-mt-c6e2e41d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c6e2e41d

openshift-ingress

deployment-controller

e2e-mt-c6e2e41d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6e2e41d-openshift-default-74bf689784 from 0 to 1

openshift-ingress

multus

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6e2e41d-55658b5585

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6e2e41d-55658b5585

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c6e2e41d-55658b5585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6e2e41d: serviceaccount "payload-processing-e2e-mt-c6e2e41d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6e2e41d: serviceaccount "payload-processing-e2e-mt-c6e2e41d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c6e2e41d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c6e2e41d-55658b5585 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c6e2e41d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76b274-6f96f68b78-jmxs7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-76b274

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-76b274: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-76b274": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-76b274, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a6aada8f-bb71-4720-828d-1821e6ec67c1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76b274-6b8b989b8f-4ssmb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-76b274-openshift-default-5d877c9fdb-vnml4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-31e7cb-c7b9bf57-zv75l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-31e7cb-595db48894-lvfvt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-31e7cb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-31e7cb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-31e7cb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-31e7cb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c5c47b73-5174-4cf9-9bba-7159df55934a, UID in object meta:

openshift-ingress

kubelet

e2e-inf-b-31e7cb-openshift-default-79bb4c5598-zhnfx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b

SuccessfulCreate

Created pod: e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

openshift-ingress

deployment-controller

e2e-shared-a-w3-14acb0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-14acb0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-14acb0

openshift-ingress

multus

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.302s (3.302s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e2e41d-69bbf46cfd-cf689

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e2e41d-55658b5585-jl2l2

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-14acb0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-14acb0: serviceaccount "payload-processing-e2e-shared-a-w3-14acb0" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-14acb0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-14acb0: serviceaccount "payload-processing-e2e-shared-a-w3-14acb0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-c6e2e41d-openshift-default-74bf689784-sbwtv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": read tcp 10.132.0.2:59954->10.132.0.55:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": read tcp 10.132.0.2:59954->10.132.0.55:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b

SuccessfulCreate

Created pod: e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-290e03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-290e03

openshift-ingress

deployment-controller

e2e-shared-a-w2-290e03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-290e03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

openshift-ingress

replicaset-controller

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8

SuccessfulCreate

Created pod: e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-290e03: serviceaccount "payload-processing-e2e-shared-a-w2-290e03" not found

openshift-ingress

deployment-controller

e2e-shared-b-w3-755926-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-755926-openshift-default-69cf84f7c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-290e03-b596dcb55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-290e03-b596dcb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-290e03: serviceaccount "payload-processing-e2e-shared-a-w2-290e03" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-290e03-b596dcb55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-290e03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-290e03-b596dcb55 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-755926

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-755926

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-755926

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-755926-5b55c7db8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-755926

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-755926: serviceaccount "payload-processing-e2e-shared-b-w3-755926" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-755926: serviceaccount "payload-processing-e2e-shared-b-w3-755926" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d

SuccessfulCreate

Created pod: e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

openshift-ingress

deployment-controller

e2e-shared-b-w2-9f71ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-9f71ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-9f71ac

openshift-ingress

multus

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-9f71ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9f71ac: serviceaccount "payload-processing-e2e-shared-b-w2-9f71ac" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9f71ac: serviceaccount "payload-processing-e2e-shared-b-w2-9f71ac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-9f71ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-8b5fd067-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8b5fd067-openshift-default-6f8857cf96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-8b5fd067-openshift-default-6f8857cf96

SuccessfulCreate

Created pod: e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

openshift-ingress

gateway_labeler_controller

e2e-mt-8b5fd067

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8b5fd067

openshift-ingress

multus

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8b5fd067-5f9f575d57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

openshift-ingress

kubelet

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8b5fd067

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8b5fd067-59c9f747d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8b5fd067: serviceaccount "payload-processing-e2e-mt-8b5fd067" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8b5fd067-5f9f575d57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8b5fd067-5f9f575d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8b5fd067: serviceaccount "payload-processing-e2e-mt-8b5fd067" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8b5fd067

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8b5fd067-5f9f575d57 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b5fd067-59c9f747d-bjggx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8b5fd067-5f9f575d57-2wtjr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-8b5fd067-openshift-default-6f8857cf96-b6zf5

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46

SuccessfulCreate

Created pod: e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

openshift-ingress

multus

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-5a30bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5a30bd

openshift-ingress

deployment-controller

e2e-api-a-5a30bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5a30bd-openshift-default-6f6bb7bc46 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5a30bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5a30bd-6854bd749d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5a30bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5a30bd-54b69c8f5c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5a30bd: serviceaccount "payload-processing-e2e-api-a-5a30bd" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5a30bd-54b69c8f5c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5a30bd-54b69c8f5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5a30bd: serviceaccount "payload-processing-e2e-api-a-5a30bd" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5a30bd-54b69c8f5c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-a22115-openshift-default-74fb7c946b

SuccessfulCreate

Created pod: e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

openshift-ingress

deployment-controller

e2e-api-b-a22115-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a22115-openshift-default-74fb7c946b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a22115

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a22115

openshift-ingress

multus

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a22115-754b7f6d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a22115-7d46f6c685

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a22115-7d46f6c685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a22115: serviceaccount "payload-processing-e2e-api-b-a22115" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a22115

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a22115-754b7f6d46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a22115

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a22115-7d46f6c685 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a22115-754b7f6d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a22115-754b7f6d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a22115: serviceaccount "payload-processing-e2e-api-b-a22115" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a22115-7d46f6c685

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

openshift-ingress

kubelet

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a30bd-6854bd749d-ds8fd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a30bd-54b69c8f5c-xqhp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-5a30bd-openshift-default-6f6bb7bc46-zmfdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a22115-754b7f6d46-58pgs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a22115-7d46f6c685-5j7ck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-a22115-openshift-default-74fb7c946b-j79fm

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-290e03

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-290e03: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-290e03": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-290e03, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2ab07c20-f55f-455d-87c9-c35f93a2d8a3, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290e03-5f5fff78b-wk2vz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290e03-b596dcb55-zbr8p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-290e03-openshift-default-7ccd8ff65b-55jw2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4

SuccessfulCreate

Created pod: e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

openshift-ingress

deployment-controller

e2e-ipp-a-84b69f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9f71ac-5bcf998866-db66x

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-84b69f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-84b69f

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9f71ac-6696c5556f-pbnnk

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-84b69f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-84b69f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-84b69f-5fbddc774c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-84b69f-5fbddc774c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-84b69f-5fbddc774c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-84b69f-5fbddc774c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-84b69f: serviceaccount "payload-processing-e2e-ipp-a-84b69f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-84b69f: serviceaccount "payload-processing-e2e-ipp-a-84b69f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-9f71ac-openshift-default-6d4b89d49d-5mdxc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-868994-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-868994-openshift-default-599dd7cf9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-868994-openshift-default-599dd7cf9b

SuccessfulCreate

Created pod: e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-868994

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-868994

openshift-ingress

multus

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-868994

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-868994-57bcb6cb95 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-868994-57bcb6cb95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-868994-57bcb6cb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-868994: serviceaccount "payload-processing-e2e-ipp-b-868994" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-868994

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-868994: serviceaccount "payload-processing-e2e-ipp-b-868994" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-868994-57bcb6cb95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-6e4b80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-6e4b80

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86

SuccessfulCreate

Created pod: e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

openshift-ingress

deployment-controller

e2e-ipp-cleanup-6e4b80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6e4b80: serviceaccount "payload-processing-e2e-ipp-cleanup-6e4b80" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-6e4b80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6e4b80: serviceaccount "payload-processing-e2e-ipp-cleanup-6e4b80" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-6e4b80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6e4b80-fdc8859df-p6rcb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6e4b80-688946dcf8-twpmp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ipp-cleanup-6e4b80-openshift-default-dockercfg-xxjzm); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-ipp-cleanup-6e4b80-openshift-default-5b46469d86-m68kj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-84b69f-6597c7db58-9rgl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-84b69f-5fbddc774c-x6z82

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-84b69f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-84b69f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-84b69f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-84b69f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9cc8b204-3216-4603-94c9-026425224ed2, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-84b69f-openshift-default-6dc4cd79d4-v6ksb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-868994-57bcb6cb95-x4b57

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-868994-5bc7c96c54-nz9gw

Unhealthy

Readiness probe failed: dial tcp 10.132.0.71:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-868994-openshift-default-599dd7cf9b-mtq7r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14acb0-798dbf95f7-qfs4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14acb0-7796d487c8-tgwd7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-14acb0-openshift-default-d9f8bfc8b-vclkp

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-755926

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-755926: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-755926": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-755926, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 42586437-46f3-4987-8bce-125c3e02d139, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-755926-5b55c7db8f-257dt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-755926-6fff89764b-wqfz5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-755926-openshift-default-69cf84f7c8-8vhnt

Killing

Stopping container istio-proxy