Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54 to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f32d75-openshift-default-856585647d-xhm8v to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw to ip-10-0-136-122.ec2.internal

openshift-ingress

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd to ip-10-0-139-11.ec2.internal

openshift-ingress

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279 to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Scheduled

Successfully assigned openshift-ingress/e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79 to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2 to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7 to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7 to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8 to ip-10-0-134-9.ec2.internal

openshift-ingress

kube-auth-proxy-b5b58d48c-cktvx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b5b58d48c-cktvx to ip-10-0-139-11.ec2.internal

openshift-ingress

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5 to ip-10-0-134-9.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6x2zg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6x2zg to ip-10-0-139-11.ec2.internal

openshift-ingress

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s to ip-10-0-134-9.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zbzjr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbzjr to ip-10-0-134-9.ec2.internal

openshift-ingress

kube-auth-proxy-b5b58d48c-sjl65

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65 to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-25381b71-5866f6986f-x77xg to ip-10-0-139-11.ec2.internal

openshift-ingress

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m to ip-10-0-136-122.ec2.internal

openshift-ingress

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj to ip-10-0-136-122.ec2.internal

openshift-ingress

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94 to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk to ip-10-0-134-9.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c54rwr to ip-10-0-134-9.ec2.internal

openshift-ingress

router-default-8646695894-4pgll

Scheduled

Successfully assigned openshift-ingress/router-default-8646695894-4pgll to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9 to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9 to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Scheduled

Successfully assigned openshift-ingress/e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2zdst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2zdst to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7083b0df-94bd57899-tq72p to ip-10-0-139-11.ec2.internal

openshift-ingress

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq to ip-10-0-136-122.ec2.internal

openshift-ingress

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w to ip-10-0-134-9.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq to ip-10-0-139-11.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm to ip-10-0-136-122.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-qb9kv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-qb9kv to ip-10-0-134-9.ec2.internal

openshift-ingress

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6 to ip-10-0-134-9.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-k7z58

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k7z58 to ip-10-0-134-9.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8646695894 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-8646695894

FailedCreate

Error creating: pods "router-default-8646695894-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-8646695894

FailedCreate

Error creating: pods "router-default-8646695894-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8646695894

SuccessfulCreate

Created pod: router-default-8646695894-4pgll
(x6)

openshift-ingress

kubelet

router-default-8646695894-4pgll

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-8646695894-4pgll

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-8646695894-4pgll

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-8646695894-4pgll

Started

Started container router

openshift-ingress

kubelet

router-default-8646695894-4pgll

Created

Created container: router

openshift-ingress

multus

router-default-8646695894-4pgll

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-b5b58d48c

FailedCreate

Error creating: pods "kube-auth-proxy-b5b58d48c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-cktvx

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-b5b58d48c from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-b5b58d48c

SuccessfulCreate

Created pod: kube-auth-proxy-b5b58d48c-cktvx

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-sjl65

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-b5b58d48c

SuccessfulCreate

Created pod: kube-auth-proxy-b5b58d48c-sjl65

openshift-ingress

multus

kube-auth-proxy-b5b58d48c-cktvx

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-b5b58d48c-sjl65

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-cktvx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-sjl65

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6x2zg

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6x2zg

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-sjl65

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-cktvx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-sjl65

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.925s (2.925s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-sjl65

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-cktvx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5b58d48c-cktvx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.908s (2.908s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.644s (3.644s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.074s (4.074s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c54rwr

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zbzjr

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zbzjr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zbzjr

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zbzjr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zbzjr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.431s (2.431s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zbzjr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6x2zg

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6x2zg

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-k7z58

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-k7z58

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-qb9kv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2zdst

openshift-ingress

multus

payload-processing-5b54b7fbb7-qb9kv

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qb9kv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2zdst

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zdst

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zdst

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zdst

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zdst

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.754s (1.754s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qb9kv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.82s (2.82s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qb9kv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qb9kv

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-k7z58

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-k7z58

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-k7z58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-k7z58

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-k7z58

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-80d47c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-80d47c-openshift-default-5cb47bf4f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-80d47c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-80d47c

openshift-ingress

replicaset-controller

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4

SuccessfulCreate

Created pod: e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

openshift-ingress

multus

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-80d47c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-80d47c-69c5bd6489 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-80d47c-69c5bd6489

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-80d47c-69c5bd6489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-80d47c: serviceaccount "payload-processing-e2e-inf-a-80d47c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-80d47c-69c5bd6489

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-80d47c-54bb695654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-80d47c-54bb695654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-80d47c: serviceaccount "payload-processing-e2e-inf-a-80d47c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-80d47c-54bb695654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-80d47c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-80d47c-54bb695654 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-7083b0df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7083b0df-openshift-default-679cb548c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-7083b0df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7083b0df

openshift-ingress

replicaset-controller

e2e-ait-7083b0df-openshift-default-679cb548c6

SuccessfulCreate

Created pod: e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

openshift-ingress

multus

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7083b0df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7083b0df-94bd57899 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7083b0df: serviceaccount "payload-processing-e2e-ait-7083b0df" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7083b0df-94bd57899

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7083b0df-94bd57899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7083b0df: serviceaccount "payload-processing-e2e-ait-7083b0df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7083b0df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7083b0df-86f7646c5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7083b0df-94bd57899

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

openshift-ingress

multus

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-d5048f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-d5048f

openshift-ingress

deployment-controller

e2e-autores-d5048f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-d5048f-openshift-default-5546cb67b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-d5048f-openshift-default-5546cb67b4

SuccessfulCreate

Created pod: e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

openshift-ingress

multus

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d5048f-d4c6b8867

FailedCreate

Error creating: pods "payload-processing-e2e-autores-d5048f-d4c6b8867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d5048f: serviceaccount "payload-processing-e2e-autores-d5048f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d5048f-85dbbf544b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d5048f-85dbbf544b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-d5048f-85dbbf544b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d5048f: serviceaccount "payload-processing-e2e-autores-d5048f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-d5048f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-d5048f-d4c6b8867 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d5048f-d4c6b8867

SuccessfulCreate

Created pod: payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-d5048f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-d5048f-85dbbf544b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-8a850d

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-8a850d-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-8a850d-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8a850d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8a850d

openshift-ingress

deployment-controller

e2e-inf-b-8a850d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8a850d-openshift-default-5895888b68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-8a850d-openshift-default-5895888b68

SuccessfulCreate

Created pod: e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2
(x2)

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8a850d: serviceaccount "payload-processing-e2e-inf-b-8a850d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8a850d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8a850d-6b488cfbc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8a850d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8a850d-55887f7c54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8a850d-6b488cfbc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8a850d-6b488cfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8a850d: serviceaccount "payload-processing-e2e-inf-b-8a850d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8a850d-6b488cfbc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-7083b0df-94bd57899-tq72p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7083b0df-86f7646c5d-hrt6d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7083b0df-openshift-default-679cb548c6-zxhmx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-d8392afe-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d8392afe-gw-openshift-default-6cf688477b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-d8392afe-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d8392afe-gw

openshift-ingress

replicaset-controller

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b

SuccessfulCreate

Created pod: e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.786s (2.786s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d8392afe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d8392afe-6cdffc7766 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d8392afe-6cdffc7766

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d8392afe-6cdffc7766

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d8392afe-6cdffc7766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d8392afe: serviceaccount "payload-processing-e2e-migrate-d8392afe" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d8392afe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d8392afe-56d79847d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d8392afe: serviceaccount "payload-processing-e2e-migrate-d8392afe" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8392afe-6cdffc7766-j66lx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8392afe-56d79847d6-ft8fc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-96d7ee49-openshift-default-d4985ff7d

SuccessfulCreate

Created pod: e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

openshift-ingress

deployment-controller

e2e-ait-96d7ee49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-96d7ee49-openshift-default-d4985ff7d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-96d7ee49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-96d7ee49

openshift-ingress

kubelet

e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-96d7ee49-67d8676db5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-96d7ee49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-96d7ee49: serviceaccount "payload-processing-e2e-ait-96d7ee49" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-96d7ee49-67d8676db5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-96d7ee49-67d8676db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-96d7ee49: serviceaccount "payload-processing-e2e-ait-96d7ee49" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-96d7ee49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-96d7ee49-67d8676db5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-96d7ee49-67d8676db5-lhxhl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-96d7ee49-76b8bb6f74-4vvgr

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-ff2a412a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ff2a412a

openshift-ingress

kubelet

e2e-ait-96d7ee49-openshift-default-d4985ff7d-p5h79

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-ff2a412a-openshift-default-6968688b5b

SuccessfulCreate

Created pod: e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

openshift-ingress

deployment-controller

e2e-derive-ff2a412a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ff2a412a-openshift-default-6968688b5b from 0 to 1

openshift-ingress

multus

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ff2a412a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ff2a412a-56678948cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ff2a412a-56678948cc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ff2a412a-56678948cc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ff2a412a-56678948cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ff2a412a: serviceaccount "payload-processing-e2e-derive-ff2a412a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ff2a412a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ff2a412a: serviceaccount "payload-processing-e2e-derive-ff2a412a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d5048f-85dbbf544b-kgptx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-d5048f-d4c6b8867-9kbpz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ff2a412a-56b4cc59f4-wdkdt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ff2a412a-56678948cc-m59rk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-ff2a412a-openshift-default-6968688b5b-vntd6

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-ff2a412a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-ff2a412a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-ff2a412a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-ff2a412a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b202654d-cb12-417d-94e0-6176924dfaba, UID in object meta:

openshift-ingress

kubelet

e2e-autores-d5048f-openshift-default-5546cb67b4-tcf2z

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-76a9b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-76a9b8

openshift-ingress

multus

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-76a9b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-76a9b8-openshift-default-6f7964f47b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-76a9b8-openshift-default-6f7964f47b

SuccessfulCreate

Created pod: e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-76a9b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-76a9b8-59595b46f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-76a9b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-76a9b8-94c9cc9df from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-76a9b8: serviceaccount "payload-processing-e2e-explicit-76a9b8" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-76a9b8-94c9cc9df

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-76a9b8-94c9cc9df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-76a9b8: serviceaccount "payload-processing-e2e-explicit-76a9b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-76a9b8-94c9cc9df

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

openshift-ingress

kubelet

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-76a9b8-94c9cc9df-hqd54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-76a9b8-59595b46f8-frgmk

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-25381b71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-25381b71

openshift-ingress

deployment-controller

e2e-mt-25381b71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-25381b71-openshift-default-5dc76557b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-25381b71-openshift-default-5dc76557b4

SuccessfulCreate

Created pod: e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

openshift-ingress

gateway_labeler_controller

e2e-noten-f32d75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f32d75

openshift-ingress

multus

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-f32d75-openshift-default-856585647d

SuccessfulCreate

Created pod: e2e-noten-f32d75-openshift-default-856585647d-xhm8v

openshift-ingress

deployment-controller

e2e-noten-f32d75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f32d75-openshift-default-856585647d from 0 to 1

openshift-ingress

kubelet

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-25381b71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-25381b71-5866f6986f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-25381b71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-25381b71-6b87bcb64b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25381b71: serviceaccount "payload-processing-e2e-mt-25381b71" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25381b71-5866f6986f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-25381b71-5866f6986f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25381b71: serviceaccount "payload-processing-e2e-mt-25381b71" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25381b71-5866f6986f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

openshift-ingress

kubelet

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-f32d75-openshift-default-856585647d-xhm8v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-25381b71-5866f6986f-x77xg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25381b71-6b87bcb64b-z26hz

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-80d47c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-80d47c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-80d47c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-80d47c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4b482dd2-3a6b-4d41-a2af-56ee54a309be, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80d47c-54bb695654-tpmff

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80d47c-69c5bd6489-lfphd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-80d47c-openshift-default-5cb47bf4f4-vvkm5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b

SuccessfulCreate

Created pod: e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

openshift-ingress

deployment-controller

e2e-shared-a-w2-8e3dc2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8e3dc2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8e3dc2

openshift-ingress

multus

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8a850d-6b488cfbc-dbtjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8a850d-55887f7c54-nhf6p

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8e3dc2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8e3dc2: serviceaccount "payload-processing-e2e-shared-a-w2-8e3dc2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8e3dc2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8e3dc2-849c65747 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8e3dc2: serviceaccount "payload-processing-e2e-shared-a-w2-8e3dc2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-8a850d-openshift-default-5895888b68-x58h2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6

SuccessfulCreate

Created pod: e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

openshift-ingress

deployment-controller

e2e-shared-a-w3-6f8c71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-6f8c71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-6f8c71

openshift-ingress

multus

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-6f8c71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-6f8c71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6f8c71: serviceaccount "payload-processing-e2e-shared-a-w3-6f8c71" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6f8c71: serviceaccount "payload-processing-e2e-shared-a-w3-6f8c71" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": read tcp 10.132.0.2:59694->10.132.0.52:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": read tcp 10.132.0.2:59694->10.132.0.52:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:51616->10.132.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:51616->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-761990

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-761990

openshift-ingress

replicaset-controller

e2e-shared-b-w2-761990-openshift-default-6f74c8f56

SuccessfulCreate

Created pod: e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

openshift-ingress

deployment-controller

e2e-shared-b-w2-761990-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-761990-openshift-default-6f74c8f56 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-761990

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-761990-5884cdd755 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-761990-5884cdd755

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-761990-5884cdd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-761990: serviceaccount "payload-processing-e2e-shared-b-w2-761990" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-761990-5884cdd755

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-761990

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-761990-579678678b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-761990-579678678b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-761990-579678678b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-761990-579678678b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-761990: serviceaccount "payload-processing-e2e-shared-b-w2-761990" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56

SuccessfulCreate

Created pod: e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

openshift-ingress

deployment-controller

e2e-shared-b-w3-e412c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e412c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e412c4

openshift-ingress

multus

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e412c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e412c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e412c4: serviceaccount "payload-processing-e2e-shared-b-w3-e412c4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e412c4: serviceaccount "payload-processing-e2e-shared-b-w3-e412c4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-c1384d3d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c1384d3d-openshift-default-664db7bdb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c1384d3d-openshift-default-664db7bdb8

SuccessfulCreate

Created pod: e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

openshift-ingress

gateway_labeler_controller

e2e-mt-c1384d3d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c1384d3d

openshift-ingress

multus

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c1384d3d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c1384d3d-d99758f89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c1384d3d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c1384d3d-d99758f89

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c1384d3d-d99758f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c1384d3d: serviceaccount "payload-processing-e2e-mt-c1384d3d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c1384d3d: serviceaccount "payload-processing-e2e-mt-c1384d3d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c1384d3d-d99758f89

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

openshift-ingress

multus

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c1384d3d-6fdc4594bb-5rs4r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c1384d3d-d99758f89-hv75r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-a653ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a653ab-openshift-default-975cb8884 from 0 to 1

openshift-ingress

multus

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-a653ab-openshift-default-975cb8884

SuccessfulCreate

Created pod: e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

openshift-ingress

gateway_labeler_controller

e2e-api-a-a653ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a653ab
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a653ab: serviceaccount "payload-processing-e2e-api-a-a653ab" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a653ab-76885cc4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a653ab-76885cc4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a653ab-76885cc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a653ab: serviceaccount "payload-processing-e2e-api-a-a653ab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a653ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a653ab-7bb6dd6ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a653ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a653ab-76885cc4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-86fc05-openshift-default-665f6ddf66

SuccessfulCreate

Created pod: e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

openshift-ingress

deployment-controller

e2e-api-b-86fc05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-86fc05-openshift-default-665f6ddf66 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-86fc05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-86fc05

openshift-ingress

multus

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-86fc05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-86fc05-5896945d85

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-86fc05-5896945d85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-86fc05: serviceaccount "payload-processing-e2e-api-b-86fc05" not found
(x6)

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-86fc05-5896945d85

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb
(x6)

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-86fc05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-86fc05-5896945d85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-86fc05: serviceaccount "payload-processing-e2e-api-b-86fc05" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-a653ab-7bb6dd6ff9-gf2w7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a653ab-76885cc4b-j6zx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a653ab-openshift-default-975cb8884-qlbq8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-86fc05-65d7c9f9d6-5m279

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-86fc05-5896945d85-ps9vb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8e3dc2-849c65747-fncx9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-shared-a-w2-8e3dc2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-shared-a-w2-8e3dc2: Operation cannot be fulfilled on endpoints "payload-processing-e2e-shared-a-w2-8e3dc2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-shared-a-w2-8e3dc2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 021d0345-edb8-4de1-bc52-b5c58f98e6b1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8e3dc2-577b844d98-85ctt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-a85a91-openshift-default-86d97b7456

SuccessfulCreate

Created pod: e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a85a91

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a85a91

openshift-ingress

deployment-controller

e2e-ipp-a-a85a91-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a85a91-openshift-default-86d97b7456 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a85a91: serviceaccount "payload-processing-e2e-ipp-a-a85a91" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a85a91

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a85a91-7b8674bd7f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-761990-5884cdd755-92rxx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a85a91: serviceaccount "payload-processing-e2e-ipp-a-a85a91" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-761990-579678678b-s8g94

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a85a91

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94 from 0 to 1

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-761990

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-761990: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-761990": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-761990, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ff663df5-06ad-4e33-ae3f-ab4e2bd1968c, UID in object meta:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-f52559-openshift-default-5d96b6bc48

SuccessfulCreate

Created pod: e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

openshift-ingress

deployment-controller

e2e-ipp-b-f52559-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f52559-openshift-default-5d96b6bc48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f52559

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f52559

openshift-ingress

multus

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f52559

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f52559-894c95b46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f52559-894c95b46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f52559-894c95b46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f52559-894c95b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f52559: serviceaccount "payload-processing-e2e-ipp-b-f52559" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f52559-6876c7579

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f52559-6876c7579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f52559: serviceaccount "payload-processing-e2e-ipp-b-f52559" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f52559-6876c7579

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f52559

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f52559-6876c7579 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-7388f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-7388f5

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674

SuccessfulCreate

Created pod: e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

openshift-ingress

deployment-controller

e2e-ipp-cleanup-7388f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-7388f5-openshift-default-6d987df674 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-7388f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7388f5: serviceaccount "payload-processing-e2e-ipp-cleanup-7388f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-7388f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7388f5: serviceaccount "payload-processing-e2e-ipp-cleanup-7388f5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7388f5-77865f745d-765pk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7388f5-7df79d74c7-9cvrq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-a85a91

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-a85a91: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-a85a91": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-a85a91, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d73e9cae-d87b-45e7-8569-5db5bd456589, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a85a91-7b8674bd7f-zsdln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a85a91-78fc4ddd94-tggds

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-a85a91-openshift-default-86d97b7456-bj76s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f52559-6876c7579-5pg5w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f52559-894c95b46-pq7jd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-6f8c71

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6f8c71: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-6f8c71": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6f8c71, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6047485c-37ad-4961-bcfc-808f13f26354, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6f8c71-98c94d54-mhn9j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6f8c71-7978755cdf-l5tt9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e412c4-69f68556cd-7jcgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e412c4-5d7d58b9dc-mg4sw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf

Killing

Stopping container istio-proxy