Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-r7l5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-r7l5l to ip-10-0-141-139.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4ktwc to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf to ip-10-0-140-51.ec2.internal

openshift-ingress

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0ad997be-75796d85d9-httpc to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7 to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs to ip-10-0-140-51.ec2.internal

openshift-ingress

kube-auth-proxy-7d6df6ff46-slct7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d6df6ff46-slct7 to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27 to ip-10-0-140-51.ec2.internal

openshift-ingress

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Scheduled

Successfully assigned openshift-ingress/e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6 to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5 to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc to ip-10-0-140-51.ec2.internal

openshift-ingress

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh to ip-10-0-133-252.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm to ip-10-0-140-51.ec2.internal

openshift-ingress

router-default-6f8f7958c8-2p4xx

Scheduled

Successfully assigned openshift-ingress/router-default-6f8f7958c8-2p4xx to ip-10-0-140-51.ec2.internal

openshift-ingress

router-default-6f8f7958c8-2p4xx

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-49e398-567f8655bf-qf2pj to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq to ip-10-0-133-252.ec2.internal

openshift-ingress

kube-auth-proxy-7d6df6ff46-hkdnw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d6df6ff46-hkdnw to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Scheduled

Successfully assigned openshift-ingress/e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx to ip-10-0-140-51.ec2.internal

openshift-ingress

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lr9nq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lr9nq to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8 to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq to ip-10-0-133-252.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-rp5zl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-rp5zl to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5 to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq to ip-10-0-141-139.ec2.internal

openshift-ingress

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-357aed65-openshift-default-65599f675b-srqvl to ip-10-0-140-51.ec2.internal

openshift-ingress

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5 to ip-10-0-133-252.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cfnvw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfnvw to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc to ip-10-0-141-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq to ip-10-0-133-252.ec2.internal

openshift-ingress

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7 to ip-10-0-140-51.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7 to ip-10-0-133-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9 to ip-10-0-141-139.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6f8f7958c8 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-6f8f7958c8

FailedCreate

Error creating: pods "router-default-6f8f7958c8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6f8f7958c8

FailedCreate

Error creating: pods "router-default-6f8f7958c8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-6f8f7958c8

SuccessfulCreate

Created pod: router-default-6f8f7958c8-2p4xx
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-6f8f7958c8-2p4xx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6f8f7958c8-2p4xx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6f8f7958c8-2p4xx

Started

Started container router

openshift-ingress

kubelet

router-default-6f8f7958c8-2p4xx

Created

Created container: router

openshift-ingress

kubelet

router-default-6f8f7958c8-2p4xx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6f8f7958c8-2p4xx

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7d6df6ff46

SuccessfulCreate

Created pod: kube-auth-proxy-7d6df6ff46-slct7
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d6df6ff46

FailedCreate

Error creating: pods "kube-auth-proxy-7d6df6ff46-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d6df6ff46 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7d6df6ff46

SuccessfulCreate

Created pod: kube-auth-proxy-7d6df6ff46-hkdnw

openshift-ingress

multus

kube-auth-proxy-7d6df6ff46-hkdnw

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-hkdnw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cfnvw

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-slct7

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-9g2sq" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

multus

kube-auth-proxy-7d6df6ff46-slct7

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-slct7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cfnvw

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-hkdnw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-hkdnw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-hkdnw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.173s (3.173s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-slct7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-slct7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.629s (3.629s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-7d6df6ff46-slct7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.674s (3.674s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-rp5zl

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dd9vm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.542s (5.542s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rp5zl

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-rp5zl

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rp5zl

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rp5zl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cfnvw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfnvw

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4ktwc

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.798s (2.798s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-r7l5l
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lr9nq

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-lr9nq

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-r7l5l

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r7l5l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lr9nq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r7l5l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r7l5l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.062s (2.062s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r7l5l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lr9nq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lr9nq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lr9nq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.501s (3.501s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4ktwc

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-08c6b2-openshift-default-5d4477884

SuccessfulCreate

Created pod: e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

openshift-ingress

replicaset-controller

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd

SuccessfulCreate

Created pod: e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

openshift-ingress

deployment-controller

e2e-inf-a-08c6b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-08c6b2-openshift-default-5d4477884 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-c7d192-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-c7d192

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-c7d192

openshift-ingress

deployment-controller

e2e-worker-w4-144bfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-144bfa-openshift-default-5dc996f7dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-08c6b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-08c6b2

openshift-ingress

multus

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd

SuccessfulCreate

Created pod: e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-144bfa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-144bfa

openshift-ingress

multus

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-144bfa-7664866778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-144bfa-7664866778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-144bfa: serviceaccount "payload-processing-e2e-worker-w4-144bfa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-144bfa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-144bfa-56f9948455 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-144bfa-56f9948455

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-144bfa-56f9948455

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-144bfa-56f9948455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-144bfa: serviceaccount "payload-processing-e2e-worker-w4-144bfa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-144bfa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-144bfa-7664866778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-144bfa-7664866778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-08c6b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-08c6b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-08c6b2-7984f858bc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-08c6b2-7984f858bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-08c6b2-7984f858bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-08c6b2: serviceaccount "payload-processing-e2e-inf-a-08c6b2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-08c6b2: serviceaccount "payload-processing-e2e-inf-a-08c6b2" not found

openshift-ingress

replicaset-controller

e2e-autores-49e398-openshift-default-66cbbd759d

SuccessfulCreate

Created pod: e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-08c6b2-7984f858bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

openshift-ingress

multus

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-49e398

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-49e398

openshift-ingress

deployment-controller

e2e-autores-49e398-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-49e398-openshift-default-66cbbd759d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c7d192: serviceaccount "payload-processing-e2e-worker-w0-c7d192" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c7d192-67844f9ccf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c7d192-67844f9ccf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-c7d192-67844f9ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c7d192: serviceaccount "payload-processing-e2e-worker-w0-c7d192" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-c7d192

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-c7d192

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-c7d192-67844f9ccf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-23a9cc4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-23a9cc4a-openshift-default-775b7dcc48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-23a9cc4a-openshift-default-775b7dcc48

SuccessfulCreate

Created pod: e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-23a9cc4a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-23a9cc4a

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-23a9cc4a-7475fb94f9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-23a9cc4a-7475fb94f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-23a9cc4a: serviceaccount "payload-processing-e2e-ait-23a9cc4a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-23a9cc4a-7475fb94f9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-23a9cc4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-23a9cc4a-7475fb94f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-23a9cc4a: serviceaccount "payload-processing-e2e-ait-23a9cc4a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-23a9cc4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-49e398-567f8655bf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-49e398-567f8655bf-qf2pj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-49e398-567f8655bf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-49e398-567f8655bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-49e398: serviceaccount "payload-processing-e2e-autores-49e398" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-49e398-8fccbc594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

openshift-ingress

multus

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-49e398-8fccbc594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-49e398-8fccbc594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-49e398: serviceaccount "payload-processing-e2e-autores-49e398" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-49e398

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-49e398-567f8655bf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-49e398

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-49e398-8fccbc594 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-cbbb09-openshift-default-7657d596f6

SuccessfulCreate

Created pod: e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

openshift-ingress

deployment-controller

e2e-inf-b-cbbb09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-cbbb09-openshift-default-7657d596f6 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-cbbb09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-cbbb09

openshift-ingress

multus

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cbbb09-85f75d469f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-cbbb09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-cbbb09-85f75d469f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cbbb09-85f75d469f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-cbbb09-85f75d469f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cbbb09: serviceaccount "payload-processing-e2e-inf-b-cbbb09" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cbbb09-544b668766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-cbbb09-544b668766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cbbb09: serviceaccount "payload-processing-e2e-inf-b-cbbb09" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-cbbb09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-cbbb09-544b668766 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cbbb09-544b668766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-23a9cc4a-7475fb94f9-nfsm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-23a9cc4a-657f8fcd78-gppbh

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-d19de295-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d19de295-gw-openshift-default-6845bbcd48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48

SuccessfulCreate

Created pod: e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

openshift-ingress

gateway_labeler_controller

e2e-migrate-d19de295-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d19de295-gw

openshift-ingress

multus

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-23a9cc4a-openshift-default-775b7dcc48-2dxkx

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d19de295-55ccf8c8cd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d19de295-55ccf8c8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d19de295: serviceaccount "payload-processing-e2e-migrate-d19de295" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d19de295-55ccf8c8cd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d19de295

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d19de295-9c99867d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d19de295-9c99867d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d19de295

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d19de295-55ccf8c8cd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d19de295-9c99867d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d19de295-9c99867d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d19de295: serviceaccount "payload-processing-e2e-migrate-d19de295" not found

openshift-ingress

multus

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d19de295-9c99867d-6jq7l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d19de295-55ccf8c8cd-4nk4h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-d19de295-gw-openshift-default-6845bbcd48-9j7gs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-0ad997be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0ad997be-openshift-default-86dcbb565d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-0ad997be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0ad997be

openshift-ingress

replicaset-controller

e2e-ait-0ad997be-openshift-default-86dcbb565d

SuccessfulCreate

Created pod: e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

openshift-ingress

multus

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0ad997be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0ad997be-79c4d46cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0ad997be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0ad997be-75796d85d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ad997be-75796d85d9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0ad997be-75796d85d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ad997be: serviceaccount "payload-processing-e2e-ait-0ad997be" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ad997be-75796d85d9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0ad997be-75796d85d9-httpc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ad997be: serviceaccount "payload-processing-e2e-ait-0ad997be" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-0ad997be-75796d85d9-httpc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ad997be-79c4d46cd-2lb6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0ad997be-openshift-default-86dcbb565d-2778m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-357aed65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-357aed65

openshift-ingress

deployment-controller

e2e-derive-357aed65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-357aed65-openshift-default-65599f675b from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-357aed65-openshift-default-65599f675b

SuccessfulCreate

Created pod: e2e-derive-357aed65-openshift-default-65599f675b-srqvl

openshift-ingress

multus

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-357aed65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-357aed65-6684f46f4f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-357aed65-799bc6447d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-357aed65-6684f46f4f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-357aed65-6684f46f4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-357aed65: serviceaccount "payload-processing-e2e-derive-357aed65" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-357aed65-6684f46f4f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-357aed65-799bc6447d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-357aed65-799bc6447d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-357aed65: serviceaccount "payload-processing-e2e-derive-357aed65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-357aed65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-357aed65-799bc6447d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-357aed65

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-357aed65: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-357aed65": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-357aed65, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4940ad32-5109-42ac-b572-b96bc1162b63, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-357aed65-799bc6447d-4dmsq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-357aed65-6684f46f4f-p7hkf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-357aed65-openshift-default-65599f675b-srqvl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-49e398-8fccbc594-v2cgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-49e398-567f8655bf-qf2pj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-49e398-openshift-default-66cbbd759d-nf4cx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-ec3fed-openshift-default-6fdf496464

SuccessfulCreate

Created pod: e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

openshift-ingress

multus

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-ec3fed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ec3fed

openshift-ingress

deployment-controller

e2e-explicit-ec3fed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ec3fed-openshift-default-6fdf496464 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ec3fed-7865cdbb49

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ec3fed-7865cdbb49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ec3fed: serviceaccount "payload-processing-e2e-explicit-ec3fed" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ec3fed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ec3fed-567c4fd854 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ec3fed-7865cdbb49

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ec3fed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ec3fed-7865cdbb49 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ec3fed: serviceaccount "payload-processing-e2e-explicit-ec3fed" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8

SuccessfulCreate

Created pod: e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

openshift-ingress

deployment-controller

e2e-mt-65fdd4fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-65fdd4fd-openshift-default-6667fbb5b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-65fdd4fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-65fdd4fd

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65fdd4fd-77857ffd69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65fdd4fd-77857ffd69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-65fdd4fd-77857ffd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65fdd4fd: serviceaccount "payload-processing-e2e-mt-65fdd4fd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65fdd4fd: serviceaccount "payload-processing-e2e-mt-65fdd4fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-65fdd4fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-65fdd4fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-65fdd4fd-77857ffd69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65fdd4fd-7f8dc674cd-4zklz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65fdd4fd-77857ffd69-7jx4z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-65fdd4fd-openshift-default-6667fbb5b8-hqb66

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-290683

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-290683

openshift-ingress

deployment-controller

e2e-shared-a-w2-290683-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-290683-openshift-default-57c7b78dd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6

SuccessfulCreate

Created pod: e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

openshift-ingress

multus

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-290683: serviceaccount "payload-processing-e2e-shared-a-w2-290683" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-290683-555989d749

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-290683-555989d749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-290683: serviceaccount "payload-processing-e2e-shared-a-w2-290683" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-290683

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-290683

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-290683-555989d749 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-290683-555989d749

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2f0a78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2f0a78

openshift-ingress

deployment-controller

e2e-shared-b-w2-2f0a78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b

SuccessfulCreate

Created pod: e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

openshift-ingress

multus

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2f0a78: serviceaccount "payload-processing-e2e-shared-b-w2-2f0a78" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2f0a78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2f0a78: serviceaccount "payload-processing-e2e-shared-b-w2-2f0a78" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2f0a78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-ec3fed

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-ec3fed: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-ec3fed": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-ec3fed, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4db8cac8-b48e-416c-b570-8378483e0e87, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec3fed-567c4fd854-rt5x7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec3fed-7865cdbb49-4dpfb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-6709f1a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6709f1a7

openshift-ingress

deployment-controller

e2e-mt-6709f1a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6709f1a7-openshift-default-599dcf555b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6709f1a7-openshift-default-599dcf555b

SuccessfulCreate

Created pod: e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

openshift-ingress

multus

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6709f1a7-5dbf546cbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6709f1a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6709f1a7-55c86c99d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6709f1a7: serviceaccount "payload-processing-e2e-mt-6709f1a7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6709f1a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6709f1a7-5dbf546cbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6709f1a7-5dbf546cbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6709f1a7-5dbf546cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6709f1a7: serviceaccount "payload-processing-e2e-mt-6709f1a7" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-ec3fed-openshift-default-6fdf496464-f2z6f

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-ac1a16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ac1a16-openshift-default-5fb49fb5bb from 0 to 1

openshift-ingress

kubelet

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-ac1a16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ac1a16

openshift-ingress

kubelet

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ac1a16-openshift-default-5fb49fb5bb

SuccessfulCreate

Created pod: e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh
(x2)

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-08c6b2-6df7cb9cd-q9mx5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-08c6b2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-08c6b2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-08c6b2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-08c6b2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4ebe90ff-55f5-43ca-9b18-42ab700b255c, UID in object meta:

openshift-ingress

kubelet

e2e-noten-ac1a16-openshift-default-5fb49fb5bb-kldwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-08c6b2-7984f858bc-nmlzk

Unhealthy

Readiness probe failed: dial tcp 10.134.0.40:9004: i/o timeout

openshift-ingress

kubelet

e2e-inf-a-08c6b2-openshift-default-5d4477884-jms7z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cbbb09-85f75d469f-fmfwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cbbb09-544b668766-zmvwq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-cbbb09-openshift-default-7657d596f6-c5cbc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2fac54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2fac54

openshift-ingress

deployment-controller

e2e-shared-a-w3-2fac54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6

SuccessfulCreate

Created pod: e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

openshift-ingress

multus

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2fac54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2fac54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2fac54: serviceaccount "payload-processing-e2e-shared-a-w3-2fac54" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2fac54: serviceaccount "payload-processing-e2e-shared-a-w3-2fac54" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6fc9e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6fc9e6

openshift-ingress

deployment-controller

e2e-shared-b-w3-6fc9e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784

SuccessfulCreate

Created pod: e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

openshift-ingress

multus

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6fc9e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6fc9e6: serviceaccount "payload-processing-e2e-shared-b-w3-6fc9e6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6fc9e6: serviceaccount "payload-processing-e2e-shared-b-w3-6fc9e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6fc9e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6709f1a7-55c86c99d-gfvl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6709f1a7-5dbf546cbf-jq9n7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-6709f1a7-openshift-default-599dcf555b-phzql

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-15f6f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-15f6f2

openshift-ingress

multus

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-15f6f2-openshift-default-7c9bf84768

SuccessfulCreate

Created pod: e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

openshift-ingress

deployment-controller

e2e-api-a-15f6f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-15f6f2-openshift-default-7c9bf84768 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-15f6f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-15f6f2-5db9d8d8b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-15f6f2: serviceaccount "payload-processing-e2e-api-a-15f6f2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-15f6f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-15f6f2-77875d44c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-15f6f2: serviceaccount "payload-processing-e2e-api-a-15f6f2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-83a2bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-83a2bc-openshift-default-79d84584 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-83a2bc-openshift-default-79d84584

SuccessfulCreate

Created pod: e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

openshift-ingress

gateway_labeler_controller

e2e-api-b-83a2bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-83a2bc

openshift-ingress

multus

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-83a2bc-5484b775f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-83a2bc-5484b775f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-83a2bc: serviceaccount "payload-processing-e2e-api-b-83a2bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-83a2bc-5484b775f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-83a2bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-83a2bc-5484b775f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-83a2bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-83a2bc: serviceaccount "payload-processing-e2e-api-b-83a2bc" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-15f6f2-77875d44c4-zf4pp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-15f6f2-5db9d8d8b7-pm48s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-15f6f2-openshift-default-7c9bf84768-lht27

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-83a2bc-6477bf7d6-cfzgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-83a2bc-5484b775f-gfc2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-83a2bc-openshift-default-79d84584-ddhbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-290683-7546dcdd98-pnm98

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-290683-555989d749-5zcfd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-290683-openshift-default-57c7b78dd6-q77mh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c7d192-67844f9ccf-5kttv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c7d192-fb57bbbcd-nkspc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-2f0a78

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2f0a78: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-2f0a78": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2f0a78, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f544fe70-7c8d-45b8-9dc7-71e9fd39c0d5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2f0a78-59bd4ff499-qcqkn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2f0a78-765f68f474-88w8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-c7d192-openshift-default-7d5d48f4bd-dhqp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-2f0a78-openshift-default-5f8fffc99b-4rrv5

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-144bfa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-144bfa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-144bfa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-144bfa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 691b5ac9-2854-4b5c-b17d-e59df2011e51, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-144bfa-7664866778-kh2p9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-144bfa-56f9948455-8n2pv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-144bfa-openshift-default-5dc996f7dd-ws7l7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-027edd-openshift-default-6f84795f8b

SuccessfulCreate

Created pod: e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

openshift-ingress

deployment-controller

e2e-ipp-a-027edd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-027edd-openshift-default-6f84795f8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-027edd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-027edd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-027edd: serviceaccount "payload-processing-e2e-ipp-a-027edd" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-027edd-5f69499c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-027edd-5f69499c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-027edd: serviceaccount "payload-processing-e2e-ipp-a-027edd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-027edd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-027edd-5f69499c7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-027edd-5f69499c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-027edd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Unhealthy

Readiness probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

ProbeError

Readiness probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-10bbea-openshift-default-f67547c5d

SuccessfulCreate

Created pod: e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

openshift-ingress

deployment-controller

e2e-ipp-b-10bbea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-10bbea-openshift-default-f67547c5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-10bbea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-10bbea

openshift-ingress

multus

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-10bbea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-10bbea-5c9b98f589 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-10bbea-5c9b98f589

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-10bbea: serviceaccount "payload-processing-e2e-ipp-b-10bbea" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-10bbea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-10bbea-c56d6578 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-10bbea-5c9b98f589

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-10bbea-5c9b98f589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-10bbea: serviceaccount "payload-processing-e2e-ipp-b-10bbea" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

openshift-ingress

deployment-controller

e2e-ipp-cleanup-574f8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-574f8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-574f8b

openshift-ingress

multus

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-574f8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-574f8b: serviceaccount "payload-processing-e2e-ipp-cleanup-574f8b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-574f8b: serviceaccount "payload-processing-e2e-ipp-cleanup-574f8b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-574f8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-574f8b-7f9fbdc4bc-hf8f8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-574f8b-f96c9bc74-2twgm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-574f8b-openshift-default-7d675df8d8-4pv6g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-027edd-5f69499c7-zzcvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-027edd-7ddc7599db-z6cb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-027edd-openshift-default-6f84795f8b-46ktf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-10bbea-c56d6578-ltjgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-10bbea-5c9b98f589-bxj2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-10bbea-openshift-default-f67547c5d-hnlvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2fac54-7dfb59d654-ntv7d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2fac54-5796b4b6c7-c29rj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2fac54-openshift-default-7bbdb755d6-b9hnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6fc9e6-6447f977cd-rrrsv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6fc9e6-c8c75bccf-b7vlq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-6fc9e6-openshift-default-7bdcf8c784-hvdc5

Killing

Stopping container istio-proxy