Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg to ip-10-0-140-72.ec2.internal

openshift-ingress

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-69vj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-69vj4 to ip-10-0-140-72.ec2.internal

openshift-ingress

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l to ip-10-0-134-155.ec2.internal

openshift-ingress

router-default-b6b4698b-54vk2

Scheduled

Successfully assigned openshift-ingress/router-default-b6b4698b-54vk2 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q to ip-10-0-137-138.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vbprg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a8e967-5587c45687-hbckj to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-df0188-75948b989f-rmmgq to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64 to ip-10-0-134-155.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-fxgpq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fxgpq to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9 to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm to ip-10-0-137-138.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95 to ip-10-0-140-72.ec2.internal

openshift-ingress

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn to ip-10-0-137-138.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csl74f to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7 to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6 to ip-10-0-137-138.ec2.internal

openshift-ingress

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Scheduled

Successfully assigned openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk to ip-10-0-137-138.ec2.internal

openshift-ingress

kube-auth-proxy-565c49d7c-bgkjg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-565c49d7c-bgkjg to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-869x2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-869x2 to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v to ip-10-0-134-155.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5 to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp to ip-10-0-134-155.ec2.internal

openshift-ingress

kube-auth-proxy-565c49d7c-smwm7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-565c49d7c-smwm7 to ip-10-0-140-72.ec2.internal

openshift-ingress

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn to ip-10-0-134-155.ec2.internal

openshift-ingress

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx to ip-10-0-137-138.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs to ip-10-0-137-138.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-b6b4698b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

router-default-b6b4698b

FailedCreate

Error creating: pods "router-default-b6b4698b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-b6b4698b

FailedCreate

Error creating: pods "router-default-b6b4698b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-b6b4698b

SuccessfulCreate

Created pod: router-default-b6b4698b-54vk2
(x5)

openshift-ingress

kubelet

router-default-b6b4698b-54vk2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-b6b4698b-54vk2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-b6b4698b-54vk2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-b6b4698b-54vk2

Started

Started container router

openshift-ingress

kubelet

router-default-b6b4698b-54vk2

Created

Created container: router

openshift-ingress

multus

router-default-b6b4698b-54vk2

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-565c49d7c

SuccessfulCreate

Created pod: kube-auth-proxy-565c49d7c-smwm7
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-565c49d7c

FailedCreate

Error creating: pods "kube-auth-proxy-565c49d7c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-565c49d7c

SuccessfulCreate

Created pod: kube-auth-proxy-565c49d7c-bgkjg

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-565c49d7c from 0 to 2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-565c49d7c-bgkjg

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-fxgpq

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-bgkjg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-smwm7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-565c49d7c-smwm7

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-fxgpq

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-bgkjg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.923s (2.923s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-bgkjg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-bgkjg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-smwm7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.814s (4.814s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-smwm7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-565c49d7c-smwm7

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vbprg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vbprg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.535s (5.535s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vbprg

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799csl74f

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vbprg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vbprg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vbprg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.234s (2.234s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.176s (3.176s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fxgpq

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-fxgpq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799csl74f

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-7pcnw

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.054s (3.054s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-69vj4

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-869x2
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69vj4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-69vj4

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-869x2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-869x2

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69vj4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69vj4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69vj4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.523s (1.523s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-869x2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-869x2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-869x2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.293s (2.293s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

ProbeError

Readiness probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Unhealthy

Readiness probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-7pcnw

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-7e3543-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7e3543-openshift-default-5bd674bf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-7e3543-openshift-default-5bd674bf4

SuccessfulCreate

Created pod: e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7e3543

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7e3543

openshift-ingress

replicaset-controller

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b

SuccessfulCreate

Created pod: e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-725e67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-725e67

openshift-ingress

multus

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-01ea3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-01ea3b

openshift-ingress

deployment-controller

e2e-inf-a-01ea3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-01ea3b-openshift-default-7b5794cf8b from 0 to 1

openshift-ingress

multus

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-725e67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-725e67-openshift-default-85555c746d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-725e67-openshift-default-85555c746d

SuccessfulCreate

Created pod: e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

openshift-ingress

multus

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7e3543

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7e3543

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7e3543-59dfc588fc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7e3543: serviceaccount "payload-processing-e2e-worker-w0-7e3543" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7e3543-59dfc588fc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7e3543-59dfc588fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7e3543: serviceaccount "payload-processing-e2e-worker-w0-7e3543" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7e3543-59dfc588fc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-01ea3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-01ea3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-01ea3b: serviceaccount "payload-processing-e2e-inf-a-01ea3b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-01ea3b: serviceaccount "payload-processing-e2e-inf-a-01ea3b" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-30d5aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-30d5aa
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-725e67-667c64b48c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-725e67-667c64b48c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-725e67: serviceaccount "payload-processing-e2e-worker-w4-725e67" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-30d5aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-30d5aa-openshift-default-75666d4666 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-30d5aa-openshift-default-75666d4666

SuccessfulCreate

Created pod: e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-725e67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-725e67-667c64b48c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-725e67: serviceaccount "payload-processing-e2e-worker-w4-725e67" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-725e67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-725e67-667855bfcd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

openshift-ingress

multus

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-725e67-667c64b48c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

openshift-ingress

replicaset-controller

e2e-ait-5005f4d9-openshift-default-7dd64f55c4

SuccessfulCreate

Created pod: e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

openshift-ingress

deployment-controller

e2e-ait-5005f4d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5005f4d9-openshift-default-7dd64f55c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-5005f4d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5005f4d9

openshift-ingress

multus

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-30d5aa-577f5b65d9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-30d5aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-30d5aa-79f75c48cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

openshift-ingress

deployment-controller

payload-processing-e2e-autores-30d5aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-30d5aa-577f5b65d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-30d5aa-577f5b65d9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-30d5aa-577f5b65d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-30d5aa: serviceaccount "payload-processing-e2e-autores-30d5aa" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-30d5aa: serviceaccount "payload-processing-e2e-autores-30d5aa" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5005f4d9-65b4b9b4df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5005f4d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5005f4d9-65b4b9b4df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5005f4d9-65b4b9b4df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5005f4d9-65b4b9b4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5005f4d9: serviceaccount "payload-processing-e2e-ait-5005f4d9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5005f4d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5005f4d9-584b5798c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5005f4d9: serviceaccount "payload-processing-e2e-ait-5005f4d9" not found

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Unhealthy

Readiness probe failed: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Unhealthy

Readiness probe failed: Get "http://10.134.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

ProbeError

Readiness probe error: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

ProbeError

Readiness probe error: Get "http://10.134.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.572s (1.572s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.94s (1.94s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-39c7b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-39c7b0

openshift-ingress

deployment-controller

e2e-inf-b-39c7b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-39c7b0-openshift-default-86cd978564 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-39c7b0-openshift-default-86cd978564

SuccessfulCreate

Created pod: e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

openshift-ingress

multus

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Unhealthy

Startup probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

ProbeError

Startup probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-39c7b0-76f9c875cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-39c7b0-76f9c875cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-39c7b0: serviceaccount "payload-processing-e2e-inf-b-39c7b0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-39c7b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-39c7b0-76f9c875cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-39c7b0: serviceaccount "payload-processing-e2e-inf-b-39c7b0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-39c7b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-39c7b0-76f9c875cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95
(x2)

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

ProbeError

Readiness probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Unhealthy

Readiness probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-e0b5e00e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e0b5e00e-gw

openshift-ingress

deployment-controller

e2e-migrate-e0b5e00e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656

SuccessfulCreate

Created pod: e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7
(x5)

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

multus

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e0b5e00e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e0b5e00e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e0b5e00e-d46cdfdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e0b5e00e: serviceaccount "payload-processing-e2e-migrate-e0b5e00e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e0b5e00e: serviceaccount "payload-processing-e2e-migrate-e0b5e00e" not found
(x2)

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Started

Started container istio-proxy

openshift-ingress

multus

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-e0b5e00e-d46cdfdb-qn874

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-9baa771e-openshift-default-c4f45d874

SuccessfulCreate

Created pod: e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

openshift-ingress

gateway_labeler_controller

e2e-ait-9baa771e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9baa771e

openshift-ingress

deployment-controller

e2e-ait-9baa771e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9baa771e-openshift-default-c4f45d874 from 0 to 1

openshift-ingress

multus

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9baa771e-56645c5b98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9baa771e-56645c5b98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9baa771e-56645c5b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9baa771e: serviceaccount "payload-processing-e2e-ait-9baa771e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9baa771e-6999b97f65

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9baa771e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9baa771e-56645c5b98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9baa771e-6999b97f65

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9baa771e-6999b97f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9baa771e: serviceaccount "payload-processing-e2e-ait-9baa771e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9baa771e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9baa771e-6999b97f65 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-93ab770e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-93ab770e

openshift-ingress

deployment-controller

e2e-derive-93ab770e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-93ab770e-openshift-default-5fdff87dc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-93ab770e-openshift-default-5fdff87dc6

SuccessfulCreate

Created pod: e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

openshift-ingress

multus

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-93ab770e-769c6cf686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-93ab770e-769c6cf686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-93ab770e: serviceaccount "payload-processing-e2e-derive-93ab770e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-93ab770e-769c6cf686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-93ab770e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-93ab770e-769c6cf686 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-93ab770e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-93ab770e-65c87fd47c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-93ab770e-65c87fd47c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-93ab770e-65c87fd47c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-93ab770e-65c87fd47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-93ab770e: serviceaccount "payload-processing-e2e-derive-93ab770e" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-30d5aa-79f75c48cd-fx84v

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-30d5aa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-30d5aa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-30d5aa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-30d5aa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7483e6e2-e1ff-406e-8a1f-276ceeeca905, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-30d5aa-577f5b65d9-hbrbf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-5c37e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-5c37e0

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-5c37e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-5c37e0-openshift-default-6966656b6d from 0 to 1

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-5c37e0-openshift-default-6966656b6d

SuccessfulCreate

Created pod: e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5c37e0-66989d457

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-5c37e0-66989d457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5c37e0: serviceaccount "payload-processing-e2e-explicit-5c37e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-5c37e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-5c37e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-5c37e0-66989d457 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5c37e0: serviceaccount "payload-processing-e2e-explicit-5c37e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5c37e0-66989d457

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-dad434fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-dad434fa-openshift-default-767887fc64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-dad434fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-dad434fa

openshift-ingress

replicaset-controller

e2e-mt-dad434fa-openshift-default-767887fc64

SuccessfulCreate

Created pod: e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

openshift-ingress

multus

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dad434fa-5f7d74c749

FailedCreate

Error creating: pods "payload-processing-e2e-mt-dad434fa-5f7d74c749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dad434fa: serviceaccount "payload-processing-e2e-mt-dad434fa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-dad434fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-dad434fa-547d8b895d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dad434fa-547d8b895d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dad434fa-547d8b895d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-dad434fa-547d8b895d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dad434fa: serviceaccount "payload-processing-e2e-mt-dad434fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-dad434fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-dad434fa-5f7d74c749 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dad434fa-5f7d74c749

SuccessfulCreate

Created pod: payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dad434fa-547d8b895d-p4hxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5c37e0-66989d457-98fxn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44

SuccessfulCreate

Created pod: e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

openshift-ingress

deployment-controller

e2e-shared-a-w2-dc12d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-dc12d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-dc12d7

openshift-ingress

multus

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7: serviceaccount "payload-processing-e2e-shared-a-w2-dc12d7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7: serviceaccount "payload-processing-e2e-shared-a-w2-dc12d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-dc12d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-dc12d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-6733e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6733e9-openshift-default-75fb85fc8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-6733e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6733e9

openshift-ingress

replicaset-controller

e2e-noten-6733e9-openshift-default-75fb85fc8

SuccessfulCreate

Created pod: e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f49968

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f49968

openshift-ingress

deployment-controller

e2e-shared-b-w2-f49968-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f49968-openshift-default-6df87976d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f49968-openshift-default-6df87976d

SuccessfulCreate

Created pod: e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

multus

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f49968

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f49968-fc685df7f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f49968-fc685df7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f49968-fc685df7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f49968-fc685df7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f49968: serviceaccount "payload-processing-e2e-shared-b-w2-f49968" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f49968

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f49968: serviceaccount "payload-processing-e2e-shared-b-w2-f49968" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-025acc06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-025acc06-openshift-default-68b54dc484 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-025acc06-openshift-default-68b54dc484

SuccessfulCreate

Created pod: e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

openshift-ingress

gateway_labeler_controller

e2e-mt-025acc06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-025acc06

openshift-ingress

multus

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-025acc06-8c68f8b65

FailedCreate

Error creating: pods "payload-processing-e2e-mt-025acc06-8c68f8b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-025acc06: serviceaccount "payload-processing-e2e-mt-025acc06" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-025acc06-8c68f8b65

SuccessfulCreate

Created pod: payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

openshift-ingress

deployment-controller

payload-processing-e2e-mt-025acc06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-025acc06-8c68f8b65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-025acc06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-025acc06-85c48fc6bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-025acc06: serviceaccount "payload-processing-e2e-mt-025acc06" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:36214->10.134.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:36214->10.134.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-01ea3b-5cfd8d6bdf-ln7n4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-01ea3b-7c64f65746-h5cxj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

Unhealthy

Readiness probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879

ProbeError

Readiness probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-6733e9-openshift-default-75fb85fc8-f46hn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39c7b0-76f9c875cf-6km95

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39c7b0-56db6464b6-6tgv8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-92702a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-92702a

openshift-ingress

deployment-controller

e2e-shared-a-w3-92702a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-92702a-openshift-default-5cd489db8b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b

SuccessfulCreate

Created pod: e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

openshift-ingress

multus

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-92702a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-92702a-d74467ff7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-92702a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-92702a-d74467ff7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-92702a-d74467ff7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-92702a-d74467ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-92702a: serviceaccount "payload-processing-e2e-shared-a-w3-92702a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-92702a: serviceaccount "payload-processing-e2e-shared-a-w3-92702a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": read tcp 10.133.0.2:39192->10.133.0.81:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": read tcp 10.133.0.2:39192->10.133.0.81:15021: read: connection reset by peer

openshift-ingress

deployment-controller

e2e-shared-b-w3-e80b38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e80b38-openshift-default-7f95788494 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e80b38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e80b38
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e80b38-openshift-default-7f95788494

SuccessfulCreate

Created pod: e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e80b38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38: serviceaccount "payload-processing-e2e-shared-b-w3-e80b38" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e80b38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38: serviceaccount "payload-processing-e2e-shared-b-w3-e80b38" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-025acc06-85c48fc6bb-plv6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-025acc06-8c68f8b65-frsqn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-a8e967-openshift-default-784979ccd4

SuccessfulCreate

Created pod: e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

openshift-ingress

deployment-controller

e2e-api-a-a8e967-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a8e967-openshift-default-784979ccd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-a8e967

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a8e967

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a8e967

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a8e967-5587c45687 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a8e967

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a8e967-84f8899bc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a8e967-5587c45687

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a8e967-5587c45687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a8e967: serviceaccount "payload-processing-e2e-api-a-a8e967" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a8e967-5587c45687

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a8e967: serviceaccount "payload-processing-e2e-api-a-a8e967" not found

openshift-ingress

deployment-controller

e2e-api-b-df0188-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-df0188-openshift-default-6b7b66f884 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-df0188

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-df0188

openshift-ingress

replicaset-controller

e2e-api-b-df0188-openshift-default-6b7b66f884

SuccessfulCreate

Created pod: e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

openshift-ingress

multus

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-df0188

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-df0188-75948b989f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-df0188-75948b989f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-df0188-75948b989f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-df0188: serviceaccount "payload-processing-e2e-api-b-df0188" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-df0188-75948b989f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-df0188-8457bd559d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-df0188

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-df0188-8457bd559d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-df0188-8457bd559d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-df0188-8457bd559d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-df0188: serviceaccount "payload-processing-e2e-api-b-df0188" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

ProbeError

Readiness probe error: Get "http://10.133.0.86:15021/healthz/ready": read tcp 10.133.0.2:57520->10.133.0.86:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Unhealthy

Readiness probe failed: Get "http://10.133.0.86:15021/healthz/ready": read tcp 10.133.0.2:57520->10.133.0.86:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-a8e967-5587c45687-hbckj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a8e967-84f8899bc8-crskq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-df0188

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-df0188: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-df0188": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-df0188, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 60e23553-8d9e-4b85-ab40-536c2653dd59, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-df0188-75948b989f-rmmgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-df0188-openshift-default-6b7b66f884-9hfzg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-dc12d7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-dc12d7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b26adf9d-4c2d-4889-a7e5-6beffb0fc052, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7e3543-59dfc588fc-knvf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7e3543-649dcfdd74-nm9vg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f49968-8658b75798-b4dxt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-725e67-667c64b48c-kz47q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-725e67-667855bfcd-cgzbp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-725e67-openshift-default-85555c746d-rltdg

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-c005f8-openshift-default-847bc549c4

SuccessfulCreate

Created pod: e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c005f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c005f8

openshift-ingress

deployment-controller

e2e-ipp-a-c005f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c005f8-openshift-default-847bc549c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c005f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c005f8-59dffc985

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c005f8-59dffc985-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c005f8: serviceaccount "payload-processing-e2e-ipp-a-c005f8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c005f8-59dffc985

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c005f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c005f8-59dffc985 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c005f8: serviceaccount "payload-processing-e2e-ipp-a-c005f8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-8dc819-openshift-default-64cf6b5694

SuccessfulCreate

Created pod: e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8dc819

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8dc819

openshift-ingress

deployment-controller

e2e-ipp-b-8dc819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8dc819-openshift-default-64cf6b5694 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8dc819

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8dc819-7477658649 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8dc819-7477658649

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8dc819

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8dc819: serviceaccount "payload-processing-e2e-ipp-b-8dc819" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8dc819-7477658649

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8dc819-7477658649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8dc819: serviceaccount "payload-processing-e2e-ipp-b-8dc819" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-a6b11e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-a6b11e

openshift-ingress

deployment-controller

e2e-ipp-cleanup-a6b11e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

openshift-ingress

multus

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e: serviceaccount "payload-processing-e2e-ipp-cleanup-a6b11e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-a6b11e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e: serviceaccount "payload-processing-e2e-ipp-cleanup-a6b11e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-a6b11e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a6b11e-5487b545f8-xfd64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c005f8-6ff49f8558-sst7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8dc819-5fd6986f8b-fsn6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8dc819-7477658649-kdccd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-92702a-7865d5fc58-zgbpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-92702a-d74467ff7-6mtgx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-92702a-openshift-default-5cd489db8b-dzcxk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Unhealthy

Readiness probe failed: dial tcp 10.134.0.65:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn

Unhealthy

Readiness probe failed: dial tcp 10.134.0.64:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-e80b38

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-e80b38": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4d00255d-0085-4289-b699-2c389b02250b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-e80b38-openshift-default-7f95788494-dhflf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: