Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4 to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-5cvsq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-5cvsq to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6 to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2 to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26 to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t to ip-10-0-130-88.ec2.internal

openshift-ingress

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx to ip-10-0-130-88.ec2.internal

openshift-ingress

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws to ip-10-0-133-150.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-m5lbb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb to ip-10-0-130-88.ec2.internal

openshift-ingress

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td to ip-10-0-140-169.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tsqwk to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r to ip-10-0-140-169.ec2.internal

openshift-ingress

kube-auth-proxy-669df89dc4-gzv5p

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-669df89dc4-gzv5p to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5 to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb to ip-10-0-130-88.ec2.internal

openshift-ingress

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95 to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9 to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8 to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zc97k

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zc97k to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt to ip-10-0-140-169.ec2.internal

openshift-ingress

router-default-84884d55d8-8jzhd

Scheduled

Successfully assigned openshift-ingress/router-default-84884d55d8-8jzhd to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l to ip-10-0-140-169.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-mzlqs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mzlqs to ip-10-0-133-150.ec2.internal

openshift-ingress

kube-auth-proxy-669df89dc4-lrvxv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-669df89dc4-lrvxv to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

Scheduled

Successfully assigned openshift-ingress/e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4 to ip-10-0-133-150.ec2.internal

openshift-ingress

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5 to ip-10-0-140-169.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2 to ip-10-0-130-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7 to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4 to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6 to ip-10-0-140-169.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn to ip-10-0-140-169.ec2.internal

openshift-ingress

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-714b74-openshift-default-687644b978-9bsvv to ip-10-0-133-150.ec2.internal

openshift-ingress

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g to ip-10-0-130-88.ec2.internal

openshift-ingress

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld to ip-10-0-130-88.ec2.internal
(x7)

openshift-ingress

replicaset-controller

router-default-84884d55d8

FailedCreate

Error creating: pods "router-default-84884d55d8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-84884d55d8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-84884d55d8

FailedCreate

Error creating: pods "router-default-84884d55d8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-84884d55d8

SuccessfulCreate

Created pod: router-default-84884d55d8-8jzhd

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-qjcvt" : failed to sync configmap cache: timed out waiting for the condition
(x5)

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

Started

Started container router

openshift-ingress

kubelet

router-default-84884d55d8-8jzhd

Created

Created container: router

openshift-ingress

multus

router-default-84884d55d8-8jzhd

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-669df89dc4

FailedCreate

Error creating: pods "kube-auth-proxy-669df89dc4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-669df89dc4

SuccessfulCreate

Created pod: kube-auth-proxy-669df89dc4-gzv5p

openshift-ingress

replicaset-controller

kube-auth-proxy-669df89dc4

SuccessfulCreate

Created pod: kube-auth-proxy-669df89dc4-lrvxv

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-669df89dc4 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-669df89dc4-lrvxv

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-lrvxv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-669df89dc4-gzv5p

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-gzv5p

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-mzlqs

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-mzlqs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-gzv5p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.917s (2.917s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-lrvxv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.886s (2.886s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-gzv5p

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-gzv5p

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-lrvxv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-669df89dc4-lrvxv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.949s (3.949s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.875s (2.875s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-m5lbb

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-m5lbb

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m5lbb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m5lbb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m5lbb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m5lbb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.444s (2.444s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-mzlqs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mzlqs

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-tsqwk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.811s (2.811s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-5cvsq

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zc97k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zc97k

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-5cvsq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5cvsq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-zc97k

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5cvsq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.065s (2.065s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zc97k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.029s (2.029s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5cvsq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5cvsq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zc97k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zc97k

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tsqwk

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-f85889-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f85889-openshift-default-796cf9975d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-30919a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-30919a

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f85889

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f85889

openshift-ingress

replicaset-controller

e2e-worker-w0-30919a-openshift-default-55776b64f8

SuccessfulCreate

Created pod: e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

openshift-ingress

replicaset-controller

e2e-inf-a-f85889-openshift-default-796cf9975d

SuccessfulCreate

Created pod: e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-1312ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-1312ea

openshift-ingress

deployment-controller

e2e-worker-w0-30919a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-30919a-openshift-default-55776b64f8 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-1312ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-1312ea-openshift-default-bf594855d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-1312ea-openshift-default-bf594855d

SuccessfulCreate

Created pod: e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

openshift-ingress

multus

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f85889

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f85889-645d65964b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f85889-7cb5564b45

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f85889-7cb5564b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f85889: serviceaccount "payload-processing-e2e-inf-a-f85889" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f85889

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f85889-7cb5564b45 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f85889-645d65964b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f85889-645d65964b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f85889: serviceaccount "payload-processing-e2e-inf-a-f85889" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f85889-645d65964b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f85889-7cb5564b45

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-1312ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-1312ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-1312ea-6579d7db85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

openshift-ingress

multus

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-5abff0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5abff0
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-1312ea-6579d7db85

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-1312ea-6579d7db85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-1312ea: serviceaccount "payload-processing-e2e-worker-w4-1312ea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-1312ea-6579d7db85

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-1312ea: serviceaccount "payload-processing-e2e-worker-w4-1312ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-30919a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-30919a-55b4759c65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-5abff0-openshift-default-9c9c9b44b

SuccessfulCreate

Created pod: e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-autores-5abff0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5abff0-openshift-default-9c9c9b44b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-30919a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-30919a-55b4759c65

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-30919a-55b4759c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-30919a: serviceaccount "payload-processing-e2e-worker-w0-30919a" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-30919a: serviceaccount "payload-processing-e2e-worker-w0-30919a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-30919a-55b4759c65

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

openshift-ingress

multus

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-ait-c8b03106-openshift-default-66dc565f8

SuccessfulCreate

Created pod: e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

openshift-ingress

deployment-controller

e2e-ait-c8b03106-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c8b03106-openshift-default-66dc565f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-c8b03106

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c8b03106

openshift-ingress

multus

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5abff0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5abff0-68f55b5545 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5abff0-68f55b5545

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5abff0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5abff0-655db4b45d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5abff0-655db4b45d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5abff0-655db4b45d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5abff0-655db4b45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5abff0: serviceaccount "payload-processing-e2e-autores-5abff0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5abff0-68f55b5545

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5abff0-68f55b5545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5abff0: serviceaccount "payload-processing-e2e-autores-5abff0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c8b03106

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c8b03106-77d5898bb5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c8b03106-77d5898bb5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c8b03106-77d5898bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c8b03106: serviceaccount "payload-processing-e2e-ait-c8b03106" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c8b03106

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c8b03106-74f998d46b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c8b03106-74f998d46b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c8b03106-74f998d46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c8b03106: serviceaccount "payload-processing-e2e-ait-c8b03106" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c8b03106-74f998d46b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

openshift-ingress

multus

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c8b03106-77d5898bb5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj
(x7)

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.092s (2.092s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Started

Started container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.965s (1.965s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-714b74-openshift-default-687644b978

SuccessfulCreate

Created pod: e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

openshift-ingress

deployment-controller

e2e-inf-b-714b74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-714b74-openshift-default-687644b978 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-714b74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-714b74

openshift-ingress

multus

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-714b74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-714b74-869588ff74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-714b74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-714b74-74dc7b979c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-714b74-74dc7b979c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-714b74-74dc7b979c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-714b74: serviceaccount "payload-processing-e2e-inf-b-714b74" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-714b74-869588ff74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-714b74-869588ff74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-714b74-869588ff74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-714b74: serviceaccount "payload-processing-e2e-inf-b-714b74" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-714b74-74dc7b979c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

openshift-ingress

multus

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8b03106-74f998d46b-pcls4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c8b03106-77d5898bb5-wr6gj

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b

SuccessfulCreate

Created pod: e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-migrate-760a0d05-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b from 0 to 1

openshift-ingress

kubelet

e2e-ait-c8b03106-openshift-default-66dc565f8-shr8k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-760a0d05-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-760a0d05-gw

openshift-ingress

multus

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-760a0d05-6d9c956654

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-760a0d05-6d9c956654

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-760a0d05-6d9c956654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-760a0d05: serviceaccount "payload-processing-e2e-migrate-760a0d05" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-760a0d05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-760a0d05-6d9c956654 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-760a0d05: serviceaccount "payload-processing-e2e-migrate-760a0d05" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-760a0d05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:35306->10.134.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:35306->10.134.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-760a0d05-gw-openshift-default-5f968b8d9b-vpftm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-760a0d05-6fbb9b8b78-d9rn6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-760a0d05-6d9c956654-n7g26

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-d7fcd5f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d7fcd5f6

openshift-ingress

deployment-controller

e2e-ait-d7fcd5f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4

SuccessfulCreate

Created pod: e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

openshift-ingress

multus

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d7fcd5f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d7fcd5f6-5f7df5545c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d7fcd5f6: serviceaccount "payload-processing-e2e-ait-d7fcd5f6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d7fcd5f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d7fcd5f6: serviceaccount "payload-processing-e2e-ait-d7fcd5f6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-5abff0-68f55b5545-9xbfv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-5abff0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-5abff0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-5abff0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-5abff0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 90a72e28-8942-47da-a7b6-cd93f25a18b6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5abff0-655db4b45d-8zzqz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d7fcd5f6-5f7df5545c-2dfth

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d7fcd5f6-59d67f8946-gv6g7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d7fcd5f6-openshift-default-68bbcff7f4-gt89q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-3eca8974-openshift-default-566d88f4cb

SuccessfulCreate

Created pod: e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

openshift-ingress

deployment-controller

e2e-derive-3eca8974-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3eca8974-openshift-default-566d88f4cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-3eca8974

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3eca8974

openshift-ingress

multus

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3eca8974

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3eca8974-7d9767cb65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3eca8974-7d9767cb65

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3eca8974

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3eca8974-767778995d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3eca8974-767778995d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3eca8974-7d9767cb65

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3eca8974-7d9767cb65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3eca8974: serviceaccount "payload-processing-e2e-derive-3eca8974" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3eca8974-767778995d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3eca8974-767778995d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3eca8974: serviceaccount "payload-processing-e2e-derive-3eca8974" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-3eca8974-7d9767cb65-fwfjq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3eca8974-767778995d-xq6m5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-2d4635

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-2d4635

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-2d4635-openshift-default-547888c8d8

SuccessfulCreate

Created pod: e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

openshift-ingress

deployment-controller

e2e-explicit-2d4635-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-2d4635-openshift-default-547888c8d8 from 0 to 1

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-5abff0-openshift-default-9c9c9b44b-26pqs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d4635-57f968f597

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-2d4635-57f968f597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d4635: serviceaccount "payload-processing-e2e-explicit-2d4635" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-2d4635

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-2d4635-57f968f597 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-2d4635

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d4635-57f968f597

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d4635: serviceaccount "payload-processing-e2e-explicit-2d4635" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4635-57f968f597-5nlrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4635-7c5869bdfd-tlkws

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-006b1977

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-006b1977

openshift-ingress

multus

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-006b1977-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-006b1977-openshift-default-5bffc788 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-006b1977-openshift-default-5bffc788

SuccessfulCreate

Created pod: e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-340098

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-340098

openshift-ingress

multus

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-340098-openshift-default-8dfbfddf6

SuccessfulCreate

Created pod: e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

openshift-ingress

deployment-controller

e2e-noten-340098-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-340098-openshift-default-8dfbfddf6 from 0 to 1

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-006b1977

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-006b1977-6d79864758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-006b1977-6d79864758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-006b1977-6d79864758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-006b1977: serviceaccount "payload-processing-e2e-mt-006b1977" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-006b1977-7c8df7c69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-006b1977-7c8df7c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-006b1977: serviceaccount "payload-processing-e2e-mt-006b1977" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-006b1977

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-006b1977-7c8df7c69 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-006b1977-6d79864758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-006b1977-7c8df7c69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

openshift-ingress

multus

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-006b1977-7c8df7c69-lfbp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-006b1977-6d79864758-mstqv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-006b1977-openshift-default-5bffc788-7vd5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756

SuccessfulCreate

Created pod: e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

openshift-ingress

deployment-controller

e2e-shared-a-w1-ac8db6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-ac8db6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-ac8db6

openshift-ingress

multus

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ac8db6: serviceaccount "payload-processing-e2e-shared-a-w1-ac8db6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-ac8db6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-ac8db6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ac8db6: serviceaccount "payload-processing-e2e-shared-a-w1-ac8db6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-noten-340098-openshift-default-8dfbfddf6-mt4zs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-719d8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-719d8a

openshift-ingress

deployment-controller

e2e-shared-b-w1-719d8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb

SuccessfulCreate

Created pod: e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

openshift-ingress

multus

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:35466->10.132.0.54:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:35466->10.132.0.54:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-719d8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-719d8a-59c4954845 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f85889-645d65964b-zzwhn

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-719d8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-719d8a-59c4954845

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-719d8a-59c4954845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-719d8a: serviceaccount "payload-processing-e2e-shared-b-w1-719d8a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-719d8a: serviceaccount "payload-processing-e2e-shared-b-w1-719d8a" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f85889-7cb5564b45-s68pw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-719d8a-59c4954845

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-714b74-869588ff74-dwc6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-714b74-74dc7b979c-wf86x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-mt-fce322fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fce322fe-openshift-default-6f8c4f988d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-fce322fe-openshift-default-6f8c4f988d

SuccessfulCreate

Created pod: e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

openshift-ingress

multus

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-714b74-openshift-default-687644b978-9bsvv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-c5adae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-c5adae

openshift-ingress

deployment-controller

e2e-shared-a-w3-c5adae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46

SuccessfulCreate

Created pod: e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

openshift-ingress

gateway_labeler_controller

e2e-mt-fce322fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fce322fe

openshift-ingress

multus

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-c5adae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c5adae: serviceaccount "payload-processing-e2e-shared-a-w3-c5adae" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c5adae-6785f544f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-c5adae-6785f544f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c5adae: serviceaccount "payload-processing-e2e-shared-a-w3-c5adae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c5adae-6785f544f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-c5adae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-c5adae-6785f544f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fce322fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fce322fe-6f59d4c569 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fce322fe-6f59d4c569

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fce322fe-6f59d4c569-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fce322fe: serviceaccount "payload-processing-e2e-mt-fce322fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fce322fe-6f59d4c569

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fce322fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fce322fe: serviceaccount "payload-processing-e2e-mt-fce322fe" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e5208b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e5208b

openshift-ingress

multus

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d

SuccessfulCreate

Created pod: e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

openshift-ingress

deployment-controller

e2e-shared-b-w3-e5208b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e5208b-openshift-default-84cccb665d from 0 to 1

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Created

Created container: istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e5208b: serviceaccount "payload-processing-e2e-shared-b-w3-e5208b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e5208b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e5208b-7bcc575989 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e5208b: serviceaccount "payload-processing-e2e-shared-b-w3-e5208b" not found
(x2)

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e5208b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fce322fe-c7cf5bf86-ttxpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fce322fe-6f59d4c569-97qg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-fe8579

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-fe8579-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-fe8579-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-api-a-fe8579-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-fe8579-openshift-default-767d544976 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-fe8579-openshift-default-767d544976

SuccessfulCreate

Created pod: e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

openshift-ingress

gateway_labeler_controller

e2e-api-a-fe8579

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fe8579

openshift-ingress

multus

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-fe8579

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-fe8579-d599d4c54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-fe8579

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-fe8579-85cdd6d7c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe8579-85cdd6d7c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe8579-85cdd6d7c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-fe8579-85cdd6d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe8579: serviceaccount "payload-processing-e2e-api-a-fe8579" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe8579-d599d4c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

openshift-ingress

multus

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe8579-d599d4c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-fe8579-d599d4c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe8579: serviceaccount "payload-processing-e2e-api-a-fe8579" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-b3c07b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b3c07b-openshift-default-74d77bdf4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-b3c07b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b3c07b

openshift-ingress

replicaset-controller

e2e-api-b-b3c07b-openshift-default-74d77bdf4d

SuccessfulCreate

Created pod: e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

openshift-ingress

multus

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b3c07b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b3c07b-7dccc46b59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b3c07b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b3c07b-7dccc46b59

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b3c07b-7dccc46b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b3c07b: serviceaccount "payload-processing-e2e-api-b-b3c07b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b3c07b-7dccc46b59

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

openshift-ingress

multus

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b3c07b: serviceaccount "payload-processing-e2e-api-b-b3c07b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe8579-d599d4c54-rldb4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-fe8579

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-fe8579: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-fe8579": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-fe8579, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a91234e9-88f2-4805-ad86-362c788e5b4e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe8579-85cdd6d7c9-47mkk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-fe8579-openshift-default-767d544976-5f4w2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3c07b-7dccc46b59-6rht9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3c07b-8485b7b5f4-4xjqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w1-ac8db6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w1-ac8db6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w1-ac8db6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w1-ac8db6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 154dbea5-fff3-42c0-bb4e-2f859993876a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ac8db6-5fb745fff8-tp78r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ac8db6-5789f59d99-rkxck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-1312ea-6579d7db85-x7j5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-1312ea-5fc98968cd-bthc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-719d8a-5fb7787cd-6kchs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-719d8a-59c4954845-tgqlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-719d8a-openshift-default-79bb55bdbb-xmsr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-30919a-5f6b9896bb-94xlq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-30919a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-30919a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-30919a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-30919a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e2e54e7a-3aba-499e-b11c-cc19ea9ad301, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-30919a-55b4759c65-bcd9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-30919a-openshift-default-55776b64f8-zsfjx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c91a45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c91a45

openshift-ingress

deployment-controller

e2e-ipp-a-c91a45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c91a45-openshift-default-849bfb68cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c91a45-openshift-default-849bfb68cb

SuccessfulCreate

Created pod: e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

openshift-ingress

multus

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c91a45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c91a45-b9979db67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c91a45-b9979db67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c91a45-b9979db67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c91a45-b9979db67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c91a45: serviceaccount "payload-processing-e2e-ipp-a-c91a45" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c91a45: serviceaccount "payload-processing-e2e-ipp-a-c91a45" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c91a45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-6ea780-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6ea780-openshift-default-5cc54b94b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6ea780

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6ea780

openshift-ingress

replicaset-controller

e2e-ipp-b-6ea780-openshift-default-5cc54b94b

SuccessfulCreate

Created pod: e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

openshift-ingress

multus

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6ea780

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6ea780-6d65fdf65 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ea780: serviceaccount "payload-processing-e2e-ipp-b-6ea780" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ea780-6d65fdf65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6ea780-6d65fdf65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6ea780: serviceaccount "payload-processing-e2e-ipp-b-6ea780" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6ea780-6d65fdf65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6ea780

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-c8b83b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-c8b83b

openshift-ingress

multus

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

openshift-ingress

deployment-controller

e2e-ipp-cleanup-c8b83b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c8b83b: serviceaccount "payload-processing-e2e-ipp-cleanup-c8b83b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-c8b83b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-c8b83b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c8b83b: serviceaccount "payload-processing-e2e-ipp-cleanup-c8b83b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c8b83b-8c7c87647-42kfq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c8b83b-7b44dcf4c8-rj7qt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

ProbeError

Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-c8b83b-openshift-default-594fdc47d8-ljdhk

Unhealthy

Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c91a45-b9979db67-zzzqz

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-c91a45

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-c91a45: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-c91a45": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-c91a45, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cb7bb39b-6539-43b4-9802-07ac52bbd900, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c91a45-5d64798cc4-2qw95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6ea780-6d65fdf65-qc57n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6ea780-86c4d6445d-4ghs8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6ea780-openshift-default-5cc54b94b-26xjl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c5adae-5c7889674-h92td

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c5adae-6785f544f-7frqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e5208b-7bcc575989-lpdxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e5208b-5c4bd68946-xldnm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e5208b-openshift-default-84cccb665d-s9vwl

Killing

Stopping container istio-proxy