Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4 to ip-10-0-139-140.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-sgpws

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-sgpws to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9 to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 to ip-10-0-137-9.ec2.internal

openshift-ingress

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 to ip-10-0-130-241.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-fl68q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-fl68q to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88 to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb to ip-10-0-137-9.ec2.internal

openshift-ingress

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr to ip-10-0-130-241.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts to ip-10-0-130-241.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-k55b7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4 to ip-10-0-130-241.ec2.internal

openshift-ingress

kube-auth-proxy-5864499db4-xmxgc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5864499db4-xmxgc to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Scheduled

Successfully assigned openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97 to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd to ip-10-0-137-9.ec2.internal

openshift-ingress

kube-auth-proxy-5864499db4-dbf4x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5864499db4-dbf4x to ip-10-0-137-9.ec2.internal

openshift-ingress

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf to ip-10-0-130-241.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-szbnw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-szbnw to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 to ip-10-0-137-9.ec2.internal

openshift-ingress

router-default-769b995cc4-mf8xv

Scheduled

Successfully assigned openshift-ingress/router-default-769b995cc4-mf8xv to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6 to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j to ip-10-0-139-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5 to ip-10-0-130-241.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk to ip-10-0-139-140.ec2.internal

openshift-ingress

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j to ip-10-0-130-241.ec2.internal

openshift-ingress

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

Scheduled

Successfully assigned openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb to ip-10-0-137-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n to ip-10-0-139-140.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-769b995cc4 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

router-default-769b995cc4

FailedCreate

Error creating: pods "router-default-769b995cc4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-769b995cc4

FailedCreate

Error creating: pods "router-default-769b995cc4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-769b995cc4

SuccessfulCreate

Created pod: router-default-769b995cc4-mf8xv
(x6)

openshift-ingress

kubelet

router-default-769b995cc4-mf8xv

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-769b995cc4-mf8xv

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-769b995cc4-mf8xv

Created

Created container: router

openshift-ingress

kubelet

router-default-769b995cc4-mf8xv

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-769b995cc4-mf8xv

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-769b995cc4-mf8xv

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5864499db4 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5864499db4

FailedCreate

Error creating: pods "kube-auth-proxy-5864499db4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5864499db4

SuccessfulCreate

Created pod: kube-auth-proxy-5864499db4-xmxgc

openshift-ingress

replicaset-controller

kube-auth-proxy-5864499db4

SuccessfulCreate

Created pod: kube-auth-proxy-5864499db4-dbf4x

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-dbf4x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5864499db4-xmxgc

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5864499db4-dbf4x

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-xmxgc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-szbnw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-szbnw

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-dbf4x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-xmxgc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-dbf4x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-xmxgc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.103s (3.103s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-szbnw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-xmxgc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5864499db4-dbf4x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.176s (3.176s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-szbnw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.664s (2.664s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-szbnw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-szbnw

Created

Created container: discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.108s (3.108s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.166s (3.166s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-k55b7

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-k55b7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k55b7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k55b7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k55b7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.498s (2.498s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k55b7

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-szbnw

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-szbnw

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-b7nfd

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-sgpws

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sgpws

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-fl68q

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fl68q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-sgpws

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-fl68q

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fl68q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.798s (1.798s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fl68q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fl68q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sgpws

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sgpws

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.798s (2.798s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-sgpws

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

ProbeError

Startup probe error: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-b7nfd

Unhealthy

Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-99877a-openshift-default-6d69888f8d

SuccessfulCreate

Created pod: e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

openshift-ingress

deployment-controller

e2e-inf-a-99877a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-99877a-openshift-default-6d69888f8d from 0 to 1

openshift-ingress

multus

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-99877a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-99877a

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-99877a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-99877a-57dbf85595 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-99877a-57dbf85595

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-99877a-57dbf85595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-99877a: serviceaccount "payload-processing-e2e-inf-a-99877a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-99877a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-99877a-57874c9746 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-99877a-57874c9746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-99877a-57874c9746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-99877a-57874c9746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-99877a: serviceaccount "payload-processing-e2e-inf-a-99877a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-99877a-57dbf85595

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

openshift-ingress

kubelet

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-autores-e12be0-openshift-default-5b674995fb

SuccessfulCreate

Created pod: e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

openshift-ingress

deployment-controller

e2e-autores-e12be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e12be0-openshift-default-5b674995fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-e12be0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e12be0

openshift-ingress

replicaset-controller

e2e-ait-16046061-openshift-default-58659bf94d

SuccessfulCreate

Created pod: e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

openshift-ingress

deployment-controller

e2e-ait-16046061-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-16046061-openshift-default-58659bf94d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-16046061

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-16046061

openshift-ingress

multus

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.657s (2.657s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-16046061

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-16046061-8476478494 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-16046061-8476478494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-16046061-8476478494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-16046061: serviceaccount "payload-processing-e2e-ait-16046061" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-16046061-5b5b4dfbff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-16046061-5b5b4dfbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-16046061: serviceaccount "payload-processing-e2e-ait-16046061" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-16046061-5b5b4dfbff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

openshift-ingress

deployment-controller

payload-processing-e2e-ait-16046061

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-16046061-5b5b4dfbff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-16046061-8476478494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

openshift-ingress

kubelet

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b6b139

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b6b139

openshift-ingress

deployment-controller

e2e-inf-b-b6b139-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b6b139-openshift-default-797f5b6cc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-b6b139-openshift-default-797f5b6cc8

SuccessfulCreate

Created pod: e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e12be0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e12be0-8657f74c4b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e12be0-5d57484f9f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e12be0-5d57484f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e12be0: serviceaccount "payload-processing-e2e-autores-e12be0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e12be0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e12be0-5d57484f9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e12be0-8657f74c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e12be0-8657f74c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e12be0: serviceaccount "payload-processing-e2e-autores-e12be0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e12be0-8657f74c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

openshift-ingress

multus

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

Started

Started container payload-processing

openshift-ingress

multus

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e12be0-5d57484f9f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq
(x5)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b6b139

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b6b139-74746dfc57

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b6b139-74746dfc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b6b139: serviceaccount "payload-processing-e2e-inf-b-b6b139" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b6b139

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b6b139-74746dfc57 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b6b139-74746dfc57

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b6b139: serviceaccount "payload-processing-e2e-inf-b-b6b139" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-16046061-5b5b4dfbff-nswbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-16046061-openshift-default-dockercfg-zkcgc); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-ait-16046061-openshift-default-58659bf94d-n5wsn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d

SuccessfulCreate

Created pod: e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

openshift-ingress

deployment-controller

e2e-migrate-02a2f652-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-02a2f652-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-02a2f652-gw

openshift-ingress

multus

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-02a2f652-554df7f558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-02a2f652-554df7f558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-02a2f652: serviceaccount "payload-processing-e2e-migrate-02a2f652" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-02a2f652-784dc64dbb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-02a2f652-784dc64dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-02a2f652: serviceaccount "payload-processing-e2e-migrate-02a2f652" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-02a2f652-554df7f558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-02a2f652

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-02a2f652-554df7f558 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-02a2f652-784dc64dbb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-02a2f652

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-02a2f652-784dc64dbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-02a2f652-784dc64dbb-n42pk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-02a2f652-554df7f558-xcp7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-28f629bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-28f629bb-openshift-default-694ff8fbdb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-28f629bb-openshift-default-694ff8fbdb

SuccessfulCreate

Created pod: e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

openshift-ingress

gateway_labeler_controller

e2e-ait-28f629bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-28f629bb

openshift-ingress

multus

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ait-28f629bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-28f629bb-79d5565ffc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-28f629bb: serviceaccount "payload-processing-e2e-ait-28f629bb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-28f629bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-28f629bb-7b865fbd46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-28f629bb-79d5565ffc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-28f629bb-79d5565ffc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-28f629bb-79d5565ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-28f629bb: serviceaccount "payload-processing-e2e-ait-28f629bb" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28f629bb-7b865fbd46-2s7gf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-28f629bb-79d5565ffc-gdhxx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-a9b1abbc-openshift-default-957b59784

SuccessfulCreate

Created pod: e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

openshift-ingress

gateway_labeler_controller

e2e-derive-a9b1abbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a9b1abbc

openshift-ingress

multus

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-a9b1abbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a9b1abbc-openshift-default-957b59784 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a9b1abbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a9b1abbc-78fd7648b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a9b1abbc-78fd7648b9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a9b1abbc: serviceaccount "payload-processing-e2e-derive-a9b1abbc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a9b1abbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a9b1abbc-78fd7648b9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a9b1abbc-78fd7648b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a9b1abbc: serviceaccount "payload-processing-e2e-derive-a9b1abbc" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a9b1abbc-5c76bdf46-8fwtm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e12be0-8657f74c4b-58blj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-e12be0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-e12be0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-e12be0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-e12be0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5abbb440-4f4d-428f-ab12-7b2ec35f7ea0, UID in object meta:

openshift-ingress

kubelet

e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-8a7a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8a7a3a-openshift-default-5bf96d79c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6

SuccessfulCreate

Created pod: e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

openshift-ingress

gateway_labeler_controller

e2e-explicit-8a7a3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8a7a3a

openshift-ingress

multus

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8a7a3a-8c74d589

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8a7a3a-8c74d589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8a7a3a: serviceaccount "payload-processing-e2e-explicit-8a7a3a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8a7a3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8a7a3a: serviceaccount "payload-processing-e2e-explicit-8a7a3a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8a7a3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8a7a3a-8c74d589 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8a7a3a-8c74d589

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-8a7a3a-8c74d589-cp64n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8a7a3a-84d798ccdb-kj66j

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-noten-468f25-openshift-default-dffb8969d

SuccessfulCreate

Created pod: e2e-noten-468f25-openshift-default-dffb8969d-65dnb

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-468f25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-468f25

openshift-ingress

deployment-controller

e2e-noten-468f25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-468f25-openshift-default-dffb8969d from 0 to 1

openshift-ingress

multus

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-3882e47c-openshift-default-666747d56

SuccessfulCreate

Created pod: e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

openshift-ingress

multus

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-3882e47c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3882e47c-openshift-default-666747d56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-3882e47c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3882e47c

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3882e47c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3882e47c-74cf8b7cdf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3882e47c-86855b97fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3882e47c-86855b97fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3882e47c: serviceaccount "payload-processing-e2e-mt-3882e47c" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3882e47c-74cf8b7cdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3882e47c-86855b97fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3882e47c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3882e47c-86855b97fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3882e47c-74cf8b7cdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3882e47c-74cf8b7cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3882e47c: serviceaccount "payload-processing-e2e-mt-3882e47c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-468f25-openshift-default-dffb8969d-65dnb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b6b139-7bfd9847cd-kwm6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3882e47c-86855b97fd-wpc4t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-1ec6e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96

SuccessfulCreate

Created pod: e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1ec6e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1ec6e6

openshift-ingress

multus

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-3882e47c-openshift-default-666747d56-9pv9q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1ec6e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1ec6e6: serviceaccount "payload-processing-e2e-shared-a-w3-1ec6e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1ec6e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1ec6e6: serviceaccount "payload-processing-e2e-shared-a-w3-1ec6e6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3db535-openshift-default-768cb77694

SuccessfulCreate

Created pod: e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3db535

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3db535

openshift-ingress

deployment-controller

e2e-shared-a-w2-3db535-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3db535-openshift-default-768cb77694 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3db535

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3db535-bf87c95bf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3db535: serviceaccount "payload-processing-e2e-shared-a-w2-3db535" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3db535: serviceaccount "payload-processing-e2e-shared-a-w2-3db535" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3db535

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-233d22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-233d22

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-233d22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b

SuccessfulCreate

Created pod: e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-233d22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-233d22-8f74ff9df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-233d22: serviceaccount "payload-processing-e2e-shared-b-w3-233d22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-233d22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-233d22: serviceaccount "payload-processing-e2e-shared-b-w3-233d22" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7ce5d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7ce5d6

openshift-ingress

deployment-controller

e2e-shared-b-w2-7ce5d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d

SuccessfulCreate

Created pod: e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

openshift-ingress

multus

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ce5d6: serviceaccount "payload-processing-e2e-shared-b-w2-7ce5d6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ce5d6: serviceaccount "payload-processing-e2e-shared-b-w2-7ce5d6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7ce5d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7ce5d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-0a17a0fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0a17a0fd

openshift-ingress

replicaset-controller

e2e-mt-0a17a0fd-openshift-default-5688974dd8

SuccessfulCreate

Created pod: e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

openshift-ingress

deployment-controller

e2e-mt-0a17a0fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0a17a0fd-openshift-default-5688974dd8 from 0 to 1

openshift-ingress

multus

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0a17a0fd-5f8d88c85

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0a17a0fd-5f8d88c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0a17a0fd: serviceaccount "payload-processing-e2e-mt-0a17a0fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0a17a0fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0a17a0fd-5f8d88c85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0a17a0fd: serviceaccount "payload-processing-e2e-mt-0a17a0fd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0a17a0fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

openshift-ingress

multus

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0a17a0fd-5f8d88c85

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0a17a0fd-5f8d88c85-dc5vf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-60e450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-60e450-openshift-default-8489db69dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-60e450-openshift-default-8489db69dd

SuccessfulCreate

Created pod: e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

openshift-ingress

gateway_labeler_controller

e2e-api-a-60e450

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-60e450

openshift-ingress

multus

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-60e450

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-60e450-cb7f966c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-60e450-cb7f966c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-60e450-cb7f966c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-60e450-cb7f966c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-60e450: serviceaccount "payload-processing-e2e-api-a-60e450" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-60e450

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-60e450-6d976d495d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-60e450-6d976d495d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-60e450-6d976d495d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-60e450: serviceaccount "payload-processing-e2e-api-a-60e450" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-60e450-6d976d495d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-4336c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4336c5

openshift-ingress

deployment-controller

e2e-api-b-4336c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4336c5-openshift-default-799bb9559d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4336c5-openshift-default-799bb9559d

SuccessfulCreate

Created pod: e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

openshift-ingress

multus

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4336c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4336c5-6dd96cb94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4336c5-5d6878c8fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4336c5-5d6878c8fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4336c5-5d6878c8fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4336c5: serviceaccount "payload-processing-e2e-api-b-4336c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4336c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4336c5-5d6878c8fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4336c5: serviceaccount "payload-processing-e2e-api-b-4336c5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

openshift-ingress

multus

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-60e450-cb7f966c-4r4wh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-60e450-openshift-default-8489db69dd-mr78x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4336c5-6dd96cb94-wvgxt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-4336c5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-4336c5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-4336c5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-4336c5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 344d1856-7d39-46b8-813d-e072b07bd4d6, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ce5d6-7f55bfcb5d-59s97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ce5d6-6dc88bbb47-27d5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9bac29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9bac29

openshift-ingress

deployment-controller

e2e-ipp-a-9bac29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9bac29-openshift-default-57576dc498 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-9bac29-openshift-default-57576dc498

SuccessfulCreate

Created pod: e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

openshift-ingress

multus

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9bac29-586c6b5877

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9bac29-586c6b5877

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9bac29-586c6b5877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9bac29: serviceaccount "payload-processing-e2e-ipp-a-9bac29" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9bac29: serviceaccount "payload-processing-e2e-ipp-a-9bac29" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9bac29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9bac29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9bac29-586c6b5877 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8

SuccessfulCreate

Created pod: e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

openshift-ingress

deployment-controller

e2e-ipp-b-2eae3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2eae3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2eae3e

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-2eae3e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-2eae3e-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-2eae3e-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2eae3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2eae3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2eae3e-ffc99b85c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2eae3e: serviceaccount "payload-processing-e2e-ipp-b-2eae3e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2eae3e: serviceaccount "payload-processing-e2e-ipp-b-2eae3e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454

SuccessfulCreate

Created pod: e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-4b91c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4b91c4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-4b91c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4b91c4: serviceaccount "payload-processing-e2e-ipp-cleanup-4b91c4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-4b91c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4b91c4: serviceaccount "payload-processing-e2e-ipp-cleanup-4b91c4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-4b91c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4b91c4-876c7c977-tf6dm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc

Unhealthy

Readiness probe failed: dial tcp 10.133.0.67:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb

Unhealthy

Readiness probe failed: dial tcp 10.133.0.66:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-2eae3e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-2eae3e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-2eae3e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-2eae3e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d79543ac-ecbe-480d-8d29-379c1d77403f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2eae3e-bb6795458-jdl88

Unhealthy

Readiness probe failed: dial tcp 10.134.0.74:9004: i/o timeout

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2eae3e-ffc99b85c-4t4sc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.75:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ec6e6-5c6f49fdd7-7l7d6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ec6e6-6b7b8d5b58-hmcf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5

Unhealthy

Readiness probe failed: dial tcp 10.133.0.52:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-233d22

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-233d22: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-233d22": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-233d22, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7d194bd3-4b2a-4ad9-bb64-a98a3314bab7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-233d22-567b67558b-htmc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb

Killing

Stopping container istio-proxy