Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr to ip-10-0-140-57.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656 to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546 to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

Scheduled

Successfully assigned openshift-ingress/e2e-noten-fb4286-openshift-default-856c456576-z5dqr to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4 to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5 to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2 to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-rjs67

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-rjs67 to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl to ip-10-0-129-5.ec2.internal

openshift-ingress

router-default-5b797f8856-mpddc

Scheduled

Successfully assigned openshift-ingress/router-default-5b797f8856-mpddc to ip-10-0-130-34.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b to ip-10-0-140-57.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-mbkmp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-zt47h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk to ip-10-0-140-57.ec2.internal

openshift-ingress

kube-auth-proxy-5cb67ffb98-z4cth

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb67ffb98-z4cth to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9 to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5 to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2 to ip-10-0-129-5.ec2.internal

openshift-ingress

kube-auth-proxy-5cb67ffb98-nq844

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844 to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt to ip-10-0-129-5.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-rxxcs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs to ip-10-0-130-34.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv to ip-10-0-129-5.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l to ip-10-0-129-5.ec2.internal

openshift-ingress

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Scheduled

Successfully assigned openshift-ingress/e2e-autores-639343-openshift-default-684844c85d-b8f2q to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24 to ip-10-0-129-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652 to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x to ip-10-0-140-57.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw to ip-10-0-140-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c to ip-10-0-129-5.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b797f8856 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-5b797f8856

FailedCreate

Error creating: pods "router-default-5b797f8856-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5b797f8856

FailedCreate

Error creating: pods "router-default-5b797f8856-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5b797f8856

SuccessfulCreate

Created pod: router-default-5b797f8856-mpddc
(x6)

openshift-ingress

kubelet

router-default-5b797f8856-mpddc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5b797f8856-mpddc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5b797f8856-mpddc

Created

Created container: router

openshift-ingress

kubelet

router-default-5b797f8856-mpddc

Started

Started container router

openshift-ingress

multus

router-default-5b797f8856-mpddc

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b797f8856-mpddc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-z4cth

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-nq844

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5cb67ffb98 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb67ffb98

SuccessfulCreate

Created pod: kube-auth-proxy-5cb67ffb98-nq844
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb67ffb98

FailedCreate

Error creating: pods "kube-auth-proxy-5cb67ffb98-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb67ffb98

SuccessfulCreate

Created pod: kube-auth-proxy-5cb67ffb98-z4cth

openshift-ingress

multus

kube-auth-proxy-5cb67ffb98-nq844

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-5cb67ffb98-z4cth

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-z4cth

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-mbkmp

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-nq844

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-mbkmp

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-z4cth

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-z4cth

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-z4cth

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.669s (2.669s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-nq844

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.242s (3.242s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-nq844

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.915s (3.915s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5cb67ffb98-nq844

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.073s (4.073s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zgmhc

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-rxxcs

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rxxcs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-rxxcs

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rxxcs

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rxxcs

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rxxcs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.388s (2.388s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-mbkmp

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mbkmp

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4gqt9

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.707s (3.707s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-rjs67

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-zt47h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjs67

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-zt47h

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zt47h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-rjs67

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjs67

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zt47h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zt47h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.097s (2.097s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjs67

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.687s (1.687s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjs67

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zt47h

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4gqt9

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-701b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-701b5b-openshift-default-84bf8647fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-701b5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-701b5b

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-701b5b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-701b5b-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-701b5b-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-701b5b-openshift-default-84bf8647fb

SuccessfulCreate

Created pod: e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

openshift-ingress

kubelet

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-701b5b-858d6b8b8c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-701b5b-858d6b8b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-701b5b: serviceaccount "payload-processing-e2e-inf-a-701b5b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-701b5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-701b5b: serviceaccount "payload-processing-e2e-inf-a-701b5b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-701b5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-701b5b-858d6b8b8c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-701b5b-858d6b8b8c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

openshift-ingress

multus

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-d3f8b122

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d3f8b122

openshift-ingress

deployment-controller

e2e-ait-d3f8b122-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d3f8b122-openshift-default-7fb97b7488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-d3f8b122-openshift-default-7fb97b7488

SuccessfulCreate

Created pod: e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

openshift-ingress

replicaset-controller

e2e-autores-639343-openshift-default-684844c85d

SuccessfulCreate

Created pod: e2e-autores-639343-openshift-default-684844c85d-b8f2q

openshift-ingress

gateway_labeler_controller

e2e-autores-639343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-639343

openshift-ingress

deployment-controller

e2e-autores-639343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-639343-openshift-default-684844c85d from 0 to 1

openshift-ingress

multus

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-639343-openshift-default-684844c85d-b8f2q

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d3f8b122: serviceaccount "payload-processing-e2e-ait-d3f8b122" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d3f8b122

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d3f8b122-57d75dc9c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d3f8b122-57d75dc9c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d3f8b122

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d3f8b122-8c59f54db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d3f8b122-57d75dc9c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d3f8b122-57d75dc9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d3f8b122: serviceaccount "payload-processing-e2e-ait-d3f8b122" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-639343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-639343-54d6bb9d66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-639343-54d6bb9d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-639343-54d6bb9d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-639343: serviceaccount "payload-processing-e2e-autores-639343" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-639343-7cb59bd6df

FailedCreate

Error creating: pods "payload-processing-e2e-autores-639343-7cb59bd6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-639343: serviceaccount "payload-processing-e2e-autores-639343" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-639343-54d6bb9d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-639343-7cb59bd6df

SuccessfulCreate

Created pod: payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

openshift-ingress

deployment-controller

payload-processing-e2e-autores-639343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-639343-7cb59bd6df from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8d5457

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8d5457

openshift-ingress

deployment-controller

e2e-inf-b-8d5457-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8d5457-openshift-default-85d67c57fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-8d5457-openshift-default-85d67c57fd

SuccessfulCreate

Created pod: e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

openshift-ingress

multus

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8d5457: serviceaccount "payload-processing-e2e-inf-b-8d5457" not found
(x2)

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8d5457

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8d5457-7bd89c7ffc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8d5457

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr
(x2)

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8d5457: serviceaccount "payload-processing-e2e-inf-b-8d5457" not found
(x2)

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d3f8b122-8c59f54db-bv8h2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d3f8b122-openshift-default-7fb97b7488-r8jwb

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-2460bb62-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-2460bb62-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-2460bb62-gw-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-migrate-2460bb62-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2460bb62-gw

openshift-ingress

deployment-controller

e2e-migrate-2460bb62-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2460bb62-gw-openshift-default-5845b44c68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68

SuccessfulCreate

Created pod: e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

openshift-ingress

multus

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2460bb62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2460bb62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2460bb62-657b48f474 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2460bb62-657b48f474

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2460bb62-657b48f474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2460bb62: serviceaccount "payload-processing-e2e-migrate-2460bb62" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2460bb62-657b48f474

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2460bb62: serviceaccount "payload-processing-e2e-migrate-2460bb62" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2460bb62-6c775c86b6-f4z24

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2460bb62-657b48f474-4sspz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-6cee6e60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6cee6e60

openshift-ingress

replicaset-controller

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6

SuccessfulCreate

Created pod: e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-6cee6e60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6cee6e60-openshift-default-5b7d6d58f6 from 0 to 1

openshift-ingress

multus

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cee6e60-686bff95b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6cee6e60-686bff95b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cee6e60: serviceaccount "payload-processing-e2e-ait-6cee6e60" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6cee6e60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cee6e60: serviceaccount "payload-processing-e2e-ait-6cee6e60" not found

openshift-ingress

kubelet

e2e-migrate-2460bb62-gw-openshift-default-5845b44c68-l57zn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6cee6e60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6cee6e60-686bff95b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cee6e60-686bff95b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-639343-54d6bb9d66-pqh5c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-639343-7cb59bd6df-jvw8b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-6cee6e60-openshift-default-5b7d6d58f6-k9f8h

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-8a9d2066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8a9d2066-openshift-default-5b56d6d5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4

SuccessfulCreate

Created pod: e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

openshift-ingress

gateway_labeler_controller

e2e-derive-8a9d2066

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8a9d2066

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-1fc789-openshift-default-864cbcbf4d

SuccessfulCreate

Created pod: e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

openshift-ingress

deployment-controller

e2e-explicit-1fc789-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-1fc789-openshift-default-864cbcbf4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-1fc789

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-1fc789

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-639343-openshift-default-684844c85d-b8f2q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8a9d2066-5b48899474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8a9d2066-5b48899474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8a9d2066: serviceaccount "payload-processing-e2e-derive-8a9d2066" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8a9d2066

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8a9d2066-6cf669785 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8a9d2066-6cf669785

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8a9d2066-6cf669785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8a9d2066: serviceaccount "payload-processing-e2e-derive-8a9d2066" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8a9d2066-6cf669785

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8a9d2066

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8a9d2066-5b48899474 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8a9d2066-5b48899474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-1fc789

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-1fc789-8695c978b9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-1fc789-8695c978b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-1fc789: serviceaccount "payload-processing-e2e-explicit-1fc789" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-1fc789

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-1fc789-8695c978b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-1fc789: serviceaccount "payload-processing-e2e-explicit-1fc789" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-1fc789-8695c978b9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-8a9d2066-6cf669785-bwpzk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a9d2066-5b48899474-bkkfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-8a9d2066-openshift-default-5b56d6d5b4-tgd5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1fc789-7bbbb95ff4-mcpmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-1fc789-8695c978b9-zkxt2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-1fc789

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-1fc789: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-1fc789": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-1fc789, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 648c24f8-cc26-417e-8897-b9e9ba2be453, UID in object meta:

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-fb4286-openshift-default-856c456576

SuccessfulCreate

Created pod: e2e-noten-fb4286-openshift-default-856c456576-z5dqr

openshift-ingress

gateway_labeler_controller

e2e-noten-fb4286

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-fb4286

openshift-ingress

deployment-controller

e2e-noten-fb4286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-fb4286-openshift-default-856c456576 from 0 to 1

openshift-ingress

kubelet

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-40d55b26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-40d55b26

openshift-ingress

deployment-controller

e2e-mt-40d55b26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-40d55b26-openshift-default-7bb59b86d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-40d55b26-openshift-default-7bb59b86d8

SuccessfulCreate

Created pod: e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-40d55b26: serviceaccount "payload-processing-e2e-mt-40d55b26" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-40d55b26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-40d55b26-787b9545d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-40d55b26-787b9545d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-40d55b26-787b9545d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-40d55b26: serviceaccount "payload-processing-e2e-mt-40d55b26" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-40d55b26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-40d55b26-75cc7f8998 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-40d55b26-787b9545d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

openshift-ingress

multus

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-fb4286-openshift-default-856c456576-z5dqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-5844a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-5844a8

openshift-ingress

deployment-controller

e2e-shared-a-w3-5844a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496

SuccessfulCreate

Created pod: e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

openshift-ingress

multus

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8: serviceaccount "payload-processing-e2e-shared-a-w3-5844a8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8: serviceaccount "payload-processing-e2e-shared-a-w3-5844a8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-5844a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-5844a8-855bd94cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-5844a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-40d55b26-787b9545d9-bftk9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w

Unhealthy

Readiness probe failed: dial tcp 10.134.0.57:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-40d55b26-openshift-default-7bb59b86d8-rpwqz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-470346-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-470346-openshift-default-6554556bdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-470346

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-470346

openshift-ingress

replicaset-controller

e2e-shared-b-w3-470346-openshift-default-6554556bdb

SuccessfulCreate

Created pod: e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

openshift-ingress

multus

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e6b4e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e6b4e2

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-470346

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-470346-8658668d5 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-e6b4e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4

SuccessfulCreate

Created pod: e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-470346

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-470346-994b579d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-470346-8658668d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-470346-8658668d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-470346: serviceaccount "payload-processing-e2e-shared-b-w3-470346" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-470346-8658668d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-470346: serviceaccount "payload-processing-e2e-shared-b-w3-470346" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e6b4e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e6b4e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e6b4e2: serviceaccount "payload-processing-e2e-shared-a-w2-e6b4e2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e6b4e2: serviceaccount "payload-processing-e2e-shared-a-w2-e6b4e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-812148-openshift-default-5f66786c96

SuccessfulCreate

Created pod: e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

openshift-ingress

deployment-controller

e2e-shared-b-w2-812148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-812148-openshift-default-5f66786c96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-812148

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-812148

openshift-ingress

multus

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-812148-c8878cb7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-812148-c8878cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-812148: serviceaccount "payload-processing-e2e-shared-b-w2-812148" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-812148

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-812148-665d85598b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-812148-c8878cb7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-812148

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-812148-c8878cb7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-812148: serviceaccount "payload-processing-e2e-shared-b-w2-812148" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-7534e03d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7534e03d

openshift-ingress

deployment-controller

e2e-mt-7534e03d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7534e03d-openshift-default-8c78b7cdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7534e03d-openshift-default-8c78b7cdd

SuccessfulCreate

Created pod: e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7534e03d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7534e03d-75f5c9bfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7534e03d-75f5c9bfc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7534e03d-75f5c9bfc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7534e03d-75f5c9bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7534e03d: serviceaccount "payload-processing-e2e-mt-7534e03d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7534e03d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7534e03d: serviceaccount "payload-processing-e2e-mt-7534e03d" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7534e03d-75f5c9bfc-f7r8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b

SuccessfulCreate

Created pod: e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

openshift-ingress

deployment-controller

e2e-api-a-2d5f29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2d5f29-openshift-default-5fc5b58c9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-2d5f29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2d5f29

openshift-ingress

multus

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2d5f29: serviceaccount "payload-processing-e2e-api-a-2d5f29" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2d5f29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2d5f29-bdc775b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2d5f29-bdc775b47

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2d5f29-bdc775b47

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2d5f29-bdc775b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2d5f29: serviceaccount "payload-processing-e2e-api-a-2d5f29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2d5f29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-1f7961-openshift-default-579dc5594b

SuccessfulCreate

Created pod: e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

openshift-ingress

gateway_labeler_controller

e2e-api-b-1f7961

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1f7961

openshift-ingress

deployment-controller

e2e-api-b-1f7961-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1f7961-openshift-default-579dc5594b from 0 to 1

openshift-ingress

multus

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1f7961-658f9858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1f7961-658f9858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1f7961-658f9858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1f7961: serviceaccount "payload-processing-e2e-api-b-1f7961" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1f7961

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1f7961-658f9858 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1f7961-78c96b5d77

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1f7961-78c96b5d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1f7961: serviceaccount "payload-processing-e2e-api-b-1f7961" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1f7961

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1f7961-78c96b5d77 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1f7961-78c96b5d77

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c
(x2)

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d5f29-bdc775b47-2f546

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-b2e4f6-openshift-default-f998664b8

SuccessfulCreate

Created pod: e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

openshift-ingress

deployment-controller

e2e-ipp-a-b2e4f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b2e4f6-openshift-default-f998664b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b2e4f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b2e4f6

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b2e4f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b2e4f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b2e4f6: serviceaccount "payload-processing-e2e-ipp-a-b2e4f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b2e4f6: serviceaccount "payload-processing-e2e-ipp-a-b2e4f6" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f7961-658f9858-668pv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f7961-78c96b5d77-mqm7c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-1f7961-openshift-default-579dc5594b-nwfgz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-ipp-b-074d50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-074d50-openshift-default-6cffd6978d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-074d50-openshift-default-6cffd6978d

SuccessfulCreate

Created pod: e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-074d50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-074d50
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e6b4e2-df8c7b989-2vpcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e6b4e2-fdcb8bb8b-7wfwg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-074d50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-074d50-68bf79684b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-074d50: serviceaccount "payload-processing-e2e-ipp-b-074d50" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-074d50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-074d50-5fbd896fb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-074d50-5fbd896fb7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-074d50-5fbd896fb7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-074d50-5fbd896fb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-074d50: serviceaccount "payload-processing-e2e-ipp-b-074d50" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-e6b4e2-openshift-default-66876c8cc4-5v656

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-812148

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-812148: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-812148": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-812148, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9302a8af-da12-4cfb-86f1-22924cb58787, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-812148-665d85598b-fc7fv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3032be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3032be

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3032be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-3032be

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-3032be-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-3032be-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3032be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3032be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3032be: serviceaccount "payload-processing-e2e-ipp-cleanup-3032be" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3032be: serviceaccount "payload-processing-e2e-ipp-cleanup-3032be" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-3032be

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3032be: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-3032be": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3032be, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a9467613-ad3c-4585-b28a-e0cf0df5359b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3032be-7c7967fd97-cj6xt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3032be-7b4f6844c8-rtw4l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b2e4f6-7d899bb7bc-bt88c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-074d50-68bf79684b-zq6c4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-074d50-5fbd896fb7-vd9jg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-074d50-openshift-default-6cffd6978d-gvtfc

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-5844a8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-5844a8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1b6cbfaa-7070-401f-bd67-daefde6ec09f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-470346

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-470346": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d5877cc-5b1b-4b07-bba2-731c94f1792b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-470346-openshift-default-6554556bdb-jjb5r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: