Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn to ip-10-0-130-81.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976 to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-802c6c2a-774646596f-6745r to ip-10-0-135-232.ec2.internal

openshift-ingress

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7 to ip-10-0-135-232.ec2.internal

openshift-ingress

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh to ip-10-0-130-81.ec2.internal

openshift-ingress

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h to ip-10-0-130-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25 to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f88d7657-openshift-default-648684c7fd-qn275 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2xm5d

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2xm5d to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7 to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2 to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-rwgf8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-rwgf8 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-bhm7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-bhm7v to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5 to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf to ip-10-0-131-20.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv to ip-10-0-131-20.ec2.internal

openshift-ingress

kube-auth-proxy-66b8956864-gk67t

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66b8956864-gk67t to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-102c83-84d4578867-l2r58 to ip-10-0-135-232.ec2.internal

openshift-ingress

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls to ip-10-0-135-232.ec2.internal

openshift-ingress

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc to ip-10-0-131-20.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vjvzh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjvzh to ip-10-0-130-81.ec2.internal

openshift-ingress

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6 to ip-10-0-130-81.ec2.internal

openshift-ingress

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6 to ip-10-0-131-20.ec2.internal

openshift-ingress

router-default-94896f94d-jhtw4

Scheduled

Successfully assigned openshift-ingress/router-default-94896f94d-jhtw4 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78 to ip-10-0-131-20.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tt5l7 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-7wlzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-7wlzn to ip-10-0-135-232.ec2.internal

openshift-ingress

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws to ip-10-0-131-20.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-bw7lg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-bw7lg to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr to ip-10-0-131-20.ec2.internal

openshift-ingress

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp to ip-10-0-130-81.ec2.internal

openshift-ingress

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd to ip-10-0-130-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2 to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r to ip-10-0-131-20.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5 to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz to ip-10-0-135-232.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz to ip-10-0-135-232.ec2.internal

openshift-ingress

kube-auth-proxy-66b8956864-v2z9s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66b8956864-v2z9s to ip-10-0-130-81.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-94896f94d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

router-default-94896f94d

FailedCreate

Error creating: pods "router-default-94896f94d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-94896f94d

FailedCreate

Error creating: pods "router-default-94896f94d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-94896f94d

SuccessfulCreate

Created pod: router-default-94896f94d-jhtw4
(x5)

openshift-ingress

kubelet

router-default-94896f94d-jhtw4

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-94896f94d-jhtw4

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-94896f94d-jhtw4

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-94896f94d-jhtw4

Started

Started container router

openshift-ingress

kubelet

router-default-94896f94d-jhtw4

Created

Created container: router

openshift-ingress

kubelet

router-default-94896f94d-jhtw4

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-66b8956864

SuccessfulCreate

Created pod: kube-auth-proxy-66b8956864-gk67t

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-66b8956864 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-66b8956864

FailedCreate

Error creating: pods "kube-auth-proxy-66b8956864-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-v2z9s

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-66b8956864

SuccessfulCreate

Created pod: kube-auth-proxy-66b8956864-v2z9s

openshift-ingress

multus

kube-auth-proxy-66b8956864-gk67t

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-gk67t

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-v2z9s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-66b8956864-v2z9s

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vjvzh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-gk67t

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vjvzh

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-gk67t

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-gk67t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.672s (2.672s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-gk67t

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.188s (3.188s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-v2z9s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-v2z9s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66b8956864-v2z9s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.875s (3.875s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-9845x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.924s (2.924s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-bw7lg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bw7lg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-bw7lg

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bw7lg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.479s (2.479s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bw7lg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bw7lg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vjvzh

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vjvzh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-tt5l7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-bhm7v

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2xm5d

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bhm7v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-bhm7v

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2xm5d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-2xm5d

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bhm7v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bhm7v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.369s (1.369s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bhm7v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2xm5d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.691s (2.691s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2xm5d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2xm5d

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tt5l7

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2xm5d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bhm7v

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-85fd65c94c-7wlzn

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-85fd65c94c-7wlzn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

FailedCreate

Error creating: pods "payload-pre-processing-76f657cdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-rwgf8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-rwgf8
(x4)

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

FailedCreate

Error creating: pods "payload-processing-85fd65c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-7wlzn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

multus

payload-pre-processing-76f657cdc4-rwgf8

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-85fd65c94c-7wlzn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-7wlzn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-7wlzn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.089s (1.089s including waiting). Image size: 141049838 bytes.

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-rwgf8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.07s (2.07s including waiting). Image size: 141049838 bytes.

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-rwgf8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-rwgf8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-a-e2dea3-openshift-default-5445bf7c74

SuccessfulCreate

Created pod: e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e2dea3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e2dea3

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-b88002

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-b88002

openshift-ingress

replicaset-controller

e2e-worker-w3-b88002-openshift-default-566596cf8b

SuccessfulCreate

Created pod: e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-116778

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-116778

openshift-ingress

deployment-controller

e2e-worker-w0-116778-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-116778-openshift-default-6b75888f84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-116778-openshift-default-6b75888f84

SuccessfulCreate

Created pod: e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

openshift-ingress

deployment-controller

e2e-worker-w3-b88002-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b88002-openshift-default-566596cf8b from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-e2dea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e2dea3-openshift-default-5445bf7c74 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-b88002

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-b88002-6fc7c8585c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-b88002

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b88002-6fc7c8585c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-b88002-6fc7c8585c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b88002: serviceaccount "payload-processing-e2e-worker-w3-b88002" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b88002-6fc7c8585c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b88002: serviceaccount "payload-processing-e2e-worker-w3-b88002" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e2dea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e2dea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e2dea3-9998d5fcc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2dea3: serviceaccount "payload-processing-e2e-inf-a-e2dea3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2dea3-9998d5fcc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e2dea3-9998d5fcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e2dea3: serviceaccount "payload-processing-e2e-inf-a-e2dea3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e2dea3-9998d5fcc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-116778

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-116778-7f674fd8c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-116778: serviceaccount "payload-processing-e2e-worker-w0-116778" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-116778-7f674fd8c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-116778-7f674fd8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-116778: serviceaccount "payload-processing-e2e-worker-w0-116778" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-116778-7f674fd8c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-116778

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-116778-79c5f6864b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-7626fb93-openshift-default-79bbbc8cdb

SuccessfulCreate

Created pod: e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-7626fb93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7626fb93

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-7626fb93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7626fb93-openshift-default-79bbbc8cdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.992s (2.992s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7626fb93-5c5449b869

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7626fb93-5c5449b869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7626fb93: serviceaccount "payload-processing-e2e-ait-7626fb93" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7626fb93-5c5449b869

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7626fb93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7626fb93-5c5449b869 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7626fb93-5987c4b554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7626fb93-5987c4b554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7626fb93: serviceaccount "payload-processing-e2e-ait-7626fb93" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7626fb93-5987c4b554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7626fb93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7626fb93-5987c4b554 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a85f8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a85f8b

openshift-ingress

deployment-controller

e2e-inf-b-a85f8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a85f8b-openshift-default-68dd69554d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a85f8b-openshift-default-68dd69554d

SuccessfulCreate

Created pod: e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a85f8b-849b65786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a85f8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a85f8b-849b65786 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a85f8b-849b65786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a85f8b-849b65786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a85f8b: serviceaccount "payload-processing-e2e-inf-b-a85f8b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a85f8b-67b5868cff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a85f8b-67b5868cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a85f8b: serviceaccount "payload-processing-e2e-inf-b-a85f8b" not found
(x6)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a85f8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a85f8b-67b5868cff from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a85f8b-67b5868cff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-7626fb93-5c5449b869-v8nlb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7626fb93-5987c4b554-6rtnb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-7626fb93

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-7626fb93: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-7626fb93": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-7626fb93, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d3d1ef9-ca5f-4f96-9b7a-1f03a14db177, UID in object meta:

openshift-ingress

kubelet

e2e-ait-7626fb93-openshift-default-79bbbc8cdb-28q8h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-6d00b9e3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b

SuccessfulCreate

Created pod: e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

openshift-ingress

gateway_labeler_controller

e2e-migrate-6d00b9e3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6d00b9e3-gw

openshift-ingress

multus

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6d00b9e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6d00b9e3: serviceaccount "payload-processing-e2e-migrate-6d00b9e3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6d00b9e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6d00b9e3: serviceaccount "payload-processing-e2e-migrate-6d00b9e3" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d00b9e3-6b6cf7b5f4-4cbml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d00b9e3-695f4c6fd6-5zfhm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-6d00b9e3-gw-openshift-default-c4d74979b-ncsh6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-f88d7657

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f88d7657

openshift-ingress

deployment-controller

e2e-ait-f88d7657-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f88d7657-openshift-default-648684c7fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f88d7657-openshift-default-648684c7fd

SuccessfulCreate

Created pod: e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

openshift-ingress

multus

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f88d7657-764846fc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f88d7657-764846fc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f88d7657: serviceaccount "payload-processing-e2e-ait-f88d7657" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f88d7657-764846fc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f88d7657

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f88d7657-764846fc8b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f88d7657

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f88d7657-696b88d7df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f88d7657-696b88d7df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f88d7657-696b88d7df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f88d7657-696b88d7df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f88d7657: serviceaccount "payload-processing-e2e-ait-f88d7657" not found
(x2)

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f88d7657-696b88d7df-q2cx7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f88d7657-764846fc8b-frwt2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-6e56ebc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6e56ebc0

openshift-ingress

multus

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-6e56ebc0-openshift-default-76d6dff56d

SuccessfulCreate

Created pod: e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

openshift-ingress

deployment-controller

e2e-derive-6e56ebc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6e56ebc0-openshift-default-76d6dff56d from 0 to 1

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f88d7657-openshift-default-648684c7fd-qn275

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6e56ebc0: serviceaccount "payload-processing-e2e-derive-6e56ebc0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6e56ebc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6e56ebc0: serviceaccount "payload-processing-e2e-derive-6e56ebc0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6e56ebc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6e56ebc0-74654f4958 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-6e56ebc0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-6e56ebc0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-6e56ebc0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-6e56ebc0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 73b0d0fe-5d01-4c25-b127-2c9506b58395, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-6e56ebc0-5fb9dbd55c-jrhbr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6e56ebc0-74654f4958-rpksl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-6e56ebc0-openshift-default-76d6dff56d-qwbdn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-802c6c2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-802c6c2a

openshift-ingress

replicaset-controller

e2e-mt-802c6c2a-openshift-default-5744bb75b8

SuccessfulCreate

Created pod: e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

openshift-ingress

deployment-controller

e2e-mt-802c6c2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-802c6c2a-openshift-default-5744bb75b8 from 0 to 1

openshift-ingress

multus

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-802c6c2a-774646596f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-802c6c2a-774646596f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-802c6c2a: serviceaccount "payload-processing-e2e-mt-802c6c2a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-802c6c2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-802c6c2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-802c6c2a-774646596f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-802c6c2a: serviceaccount "payload-processing-e2e-mt-802c6c2a" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-802c6c2a-774646596f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-802c6c2a-774646596f-6745r

openshift-ingress

kubelet

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

openshift-ingress

kubelet

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-802c6c2a-589c57dbcd-szf87

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-802c6c2a-774646596f-6745r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-802c6c2a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-802c6c2a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-802c6c2a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-802c6c2a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bf36802a-7db6-4dbb-82a1-981dbeba54a4, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e2dea3-77b58d8ffd-x5vkk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e2dea3-9998d5fcc-kgq29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-802c6c2a-openshift-default-5744bb75b8-6hxc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e2dea3-openshift-default-5445bf7c74-ps2q6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-35f893-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-35f893

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-35f893

openshift-ingress

replicaset-controller

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4

SuccessfulCreate

Created pod: e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

openshift-ingress

multus

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-a85f8b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-a85f8b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-a85f8b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-a85f8b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 48bb1486-9247-4b55-ac27-a74ce4159c69, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a85f8b-67b5868cff-rmlsl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a85f8b-849b65786-6n7mg

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-35f893: serviceaccount "payload-processing-e2e-shared-a-w1-35f893" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-35f893

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-35f893-6c7597959

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-35f893-6c7597959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-35f893: serviceaccount "payload-processing-e2e-shared-a-w1-35f893" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-35f893-6c7597959

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-35f893

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-35f893-6c7597959 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-bab50d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd

SuccessfulCreate

Created pod: e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-bab50d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-bab50d

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a85f8b-openshift-default-68dd69554d-dkbnd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-bab50d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w1-9a5190-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd

SuccessfulCreate

Created pod: e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-9a5190

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-9a5190
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bab50d: serviceaccount "payload-processing-e2e-shared-a-w2-bab50d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-bab50d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bab50d: serviceaccount "payload-processing-e2e-shared-a-w2-bab50d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-9a5190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-9a5190: serviceaccount "payload-processing-e2e-shared-b-w1-9a5190" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-9a5190: serviceaccount "payload-processing-e2e-shared-b-w1-9a5190" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-9a5190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-35558b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-35558b

openshift-ingress

deployment-controller

e2e-shared-b-w2-35558b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84

SuccessfulCreate

Created pod: e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

openshift-ingress

multus

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-35558b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-35558b-665f578f4c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-35558b: serviceaccount "payload-processing-e2e-shared-b-w2-35558b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-35558b-665f578f4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-35558b-665f578f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-35558b: serviceaccount "payload-processing-e2e-shared-b-w2-35558b" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-35558b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-35558b-665f578f4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": read tcp 10.132.0.2:44092->10.132.0.76:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": read tcp 10.132.0.2:44092->10.132.0.76:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

e2e-mt-10f4b77d-openshift-default-745cc64984

SuccessfulCreate

Created pod: e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq
(x4)

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-10f4b77d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-10f4b77d-openshift-default-745cc64984 from 0 to 1
(x4)

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-10f4b77d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-10f4b77d
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-10f4b77d-6754fff886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-10f4b77d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-10f4b77d-6754fff886 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-10f4b77d-6754fff886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-10f4b77d-6754fff886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-10f4b77d: serviceaccount "payload-processing-e2e-mt-10f4b77d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-10f4b77d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-10f4b77d-6775c89ddf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-10f4b77d-6775c89ddf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-10f4b77d-6775c89ddf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-10f4b77d-6775c89ddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-10f4b77d: serviceaccount "payload-processing-e2e-mt-10f4b77d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b88002-747cf6f4bb-nzqgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b88002-6fc7c8585c-s59ls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-b88002-openshift-default-566596cf8b-8bcws

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Unhealthy

Readiness probe failed: dial tcp 10.132.0.80:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-10f4b77d-6754fff886-7rvcz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-10f4b77d-6775c89ddf-jx976

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-10f4b77d-openshift-default-745cc64984-7dxmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-116778-79c5f6864b-2zsqv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-116778-7f674fd8c5-49snz

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-116778

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-116778: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-116778": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-116778, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 035b0bd9-1284-4c54-9f48-e887ae426cdd, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w0-116778-openshift-default-6b75888f84-g7fvl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-77f5c1-openshift-default-5566bf7694

SuccessfulCreate

Created pod: e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

openshift-ingress

deployment-controller

e2e-api-a-77f5c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-77f5c1-openshift-default-5566bf7694 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-77f5c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-77f5c1

openshift-ingress

multus

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

openshift-ingress

multus

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-77f5c1: serviceaccount "payload-processing-e2e-api-a-77f5c1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-77f5c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-77f5c1: serviceaccount "payload-processing-e2e-api-a-77f5c1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-77f5c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-77f5c1-54fd9b8d7c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-102c83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-102c83-openshift-default-54c6c7d5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-102c83-openshift-default-54c6c7d5b4

SuccessfulCreate

Created pod: e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

openshift-ingress

multus

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-102c83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-102c83
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-102c83-59d466f894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-102c83-59d466f894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-102c83: serviceaccount "payload-processing-e2e-api-b-102c83" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-102c83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-102c83-59d466f894 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-102c83-59d466f894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-102c83-84d4578867

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-102c83-84d4578867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-102c83: serviceaccount "payload-processing-e2e-api-b-102c83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-102c83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-102c83-84d4578867 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-102c83-84d4578867

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-102c83-84d4578867-l2r58

openshift-ingress

multus

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77f5c1-77c8b8c5b6-k6qs7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77f5c1-54fd9b8d7c-5dvtq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-77f5c1-openshift-default-5566bf7694-qx4g5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-102c83-84d4578867-l2r58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-102c83-59d466f894-6xwbj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-102c83-openshift-default-54c6c7d5b4-ltmbf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-35f893-6c7597959-x2z2t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-35f893-777f847cc8-5clxh

Unhealthy

Readiness probe failed: dial tcp 10.132.0.73:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-a-w1-35f893-openshift-default-585dfd9fd4-zmzbf

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w1-9a5190

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w1-9a5190: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w1-9a5190": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w1-9a5190, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e4b7f34e-881a-4232-9cac-d9a9c811fa0d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9a5190-5dfbfdb79-mqcz5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9a5190-c5967f66b-9vfzg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-9a5190-openshift-default-786b5cc8dd-5lns2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8cdaea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8cdaea

openshift-ingress

replicaset-controller

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6

SuccessfulCreate

Created pod: e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

openshift-ingress

deployment-controller

e2e-ipp-a-8cdaea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8cdaea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8cdaea-6995844685 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8cdaea: serviceaccount "payload-processing-e2e-ipp-a-8cdaea" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8cdaea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8cdaea-6995844685

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8cdaea-6995844685

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8cdaea-6995844685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8cdaea: serviceaccount "payload-processing-e2e-ipp-a-8cdaea" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": read tcp 10.132.0.2:54586->10.132.0.95:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": read tcp 10.132.0.2:54586->10.132.0.95:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-667e4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-667e4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-667e4c

openshift-ingress

multus

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6

SuccessfulCreate

Created pod: e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-667e4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-667e4c-7dd5756c65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-667e4c-7dd5756c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-667e4c: serviceaccount "payload-processing-e2e-ipp-b-667e4c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-667e4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-667e4c-7dd5756c65 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-667e4c: serviceaccount "payload-processing-e2e-ipp-b-667e4c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-667e4c-7dd5756c65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-186465

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-186465

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-186465-openshift-default-7486d5f584

SuccessfulCreate

Created pod: e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

openshift-ingress

deployment-controller

e2e-ipp-cleanup-186465-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-186465-openshift-default-7486d5f584 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-186465: serviceaccount "payload-processing-e2e-ipp-cleanup-186465" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-186465

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-186465: serviceaccount "payload-processing-e2e-ipp-cleanup-186465" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-186465

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-186465-64788c88c4-4bv25

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-186465-d86bc4d8c-hl98m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-186465-openshift-default-7486d5f584-xnthp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cdaea-6995844685-bd48s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cdaea-5548bd6d66-zcts4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-8cdaea-openshift-default-f95f6c4b6-q4ftc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-667e4c-5c78db7f98-zflkp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-667e4c-7dd5756c65-qvf78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-667e4c-openshift-default-cbc5ff7d6-jz7sh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bab50d-7cc7b9fbcc-ldg6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bab50d-9867fbb94-tltwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-bab50d-openshift-default-555dd5c6cd-24xpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-35558b-56b894444b-9n9q2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-35558b-665f578f4c-mrlgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-35558b-openshift-default-6bbb5bcc84-6gxxh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503