Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw to ip-10-0-133-93.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-dd6l7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-dd6l7 to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8 to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6 to ip-10-0-133-93.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-q7grb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-q7grb to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-zw24c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-zw24c to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt to ip-10-0-130-57.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-677907eb-openshift-default-d655f65dd-25qnl to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-07cc17-openshift-default-8496c8c896-229lr to ip-10-0-130-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vrq8h to ip-10-0-130-57.ec2.internal

openshift-ingress

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6 to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm to ip-10-0-133-93.ec2.internal

openshift-ingress

router-default-775cbbfd5d-w7f9r

Scheduled

Successfully assigned openshift-ingress/router-default-775cbbfd5d-w7f9r to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48 to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj to ip-10-0-135-66.ec2.internal

openshift-ingress

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd to ip-10-0-130-57.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-pw6qh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pw6qh to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd to ip-10-0-130-57.ec2.internal

openshift-ingress

kube-auth-proxy-747b697884-whtvt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-747b697884-whtvt to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5 to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv to ip-10-0-133-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv to ip-10-0-135-66.ec2.internal

openshift-ingress

kube-auth-proxy-747b697884-hfp2m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-747b697884-hfp2m to ip-10-0-135-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg to ip-10-0-133-93.ec2.internal

openshift-ingress

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx to ip-10-0-130-57.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-775cbbfd5d from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-775cbbfd5d

FailedCreate

Error creating: pods "router-default-775cbbfd5d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-775cbbfd5d

FailedCreate

Error creating: pods "router-default-775cbbfd5d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-775cbbfd5d

SuccessfulCreate

Created pod: router-default-775cbbfd5d-w7f9r
(x5)

openshift-ingress

kubelet

router-default-775cbbfd5d-w7f9r

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-775cbbfd5d-w7f9r

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-775cbbfd5d-w7f9r

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-775cbbfd5d-w7f9r

Created

Created container: router

openshift-ingress

multus

router-default-775cbbfd5d-w7f9r

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-775cbbfd5d-w7f9r

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-747b697884 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-747b697884

FailedCreate

Error creating: pods "kube-auth-proxy-747b697884-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-747b697884-hfp2m

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-747b697884

SuccessfulCreate

Created pod: kube-auth-proxy-747b697884-whtvt

openshift-ingress

replicaset-controller

kube-auth-proxy-747b697884

SuccessfulCreate

Created pod: kube-auth-proxy-747b697884-hfp2m

openshift-ingress

kubelet

kube-auth-proxy-747b697884-whtvt

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-747b697884-whtvt

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-q7grb

openshift-ingress

kubelet

kube-auth-proxy-747b697884-whtvt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-747b697884-hfp2m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-747b697884-hfp2m

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-q7grb

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-747b697884-hfp2m

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-747b697884-hfp2m

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-747b697884-hfp2m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.305s (4.305s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-747b697884-whtvt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-747b697884-whtvt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.905s (4.905s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-747b697884-whtvt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.061s (4.061s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.108s (3.108s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-q84gf

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-dd6l7

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-dd6l7

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dd6l7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dd6l7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dd6l7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dd6l7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.566s (2.566s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-q7grb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q7grb

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vrq8h

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-zw24c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pw6qh

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-zw24c

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zw24c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pw6qh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-pw6qh

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zw24c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zw24c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.663s (2.663s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zw24c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pw6qh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pw6qh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pw6qh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.836s (3.836s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vrq8h

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-7b8369-openshift-default-c85cbf44d

SuccessfulCreate

Created pod: e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

openshift-ingress

deployment-controller

e2e-inf-a-7b8369-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7b8369-openshift-default-c85cbf44d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7b8369

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7b8369

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-7b8369

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-7b8369-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-7b8369-authn-ssl" already exists

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7b8369: serviceaccount "payload-processing-e2e-inf-a-7b8369" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7b8369-9777dbb95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7b8369-9777dbb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7b8369: serviceaccount "payload-processing-e2e-inf-a-7b8369" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7b8369-9777dbb95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7b8369

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7b8369-9777dbb95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7b8369

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-083463c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-083463c6

openshift-ingress

gateway_labeler_controller

e2e-autores-a09c2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a09c2a

openshift-ingress

deployment-controller

e2e-ait-083463c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-083463c6-openshift-default-68f9b5f6bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-083463c6-openshift-default-68f9b5f6bb

SuccessfulCreate

Created pod: e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

openshift-ingress

multus

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-a09c2a-openshift-default-564444cf78

SuccessfulCreate

Created pod: e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

openshift-ingress

deployment-controller

e2e-autores-a09c2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a09c2a-openshift-default-564444cf78 from 0 to 1

openshift-ingress

multus

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-083463c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-083463c6-699755b9b5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-083463c6-f65b69cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-083463c6-f65b69cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-083463c6-f65b69cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-083463c6: serviceaccount "payload-processing-e2e-ait-083463c6" not found

openshift-ingress

multus

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-083463c6-699755b9b5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-083463c6-699755b9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-083463c6: serviceaccount "payload-processing-e2e-ait-083463c6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-083463c6-699755b9b5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

openshift-ingress

kubelet

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-083463c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-083463c6-f65b69cf4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a09c2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a09c2a-6c59646f7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a09c2a-6c59646f7c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

openshift-ingress

multus

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a09c2a-6c59646f7c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a09c2a-6c59646f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a09c2a: serviceaccount "payload-processing-e2e-autores-a09c2a" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a09c2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a09c2a-7d78799598 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a09c2a-7d78799598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a09c2a-7d78799598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a09c2a-7d78799598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a09c2a: serviceaccount "payload-processing-e2e-autores-a09c2a" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:15021/healthz/ready": read tcp 10.132.0.2:55680->10.132.0.40:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

ProbeError

Readiness probe error: Get "http://10.132.0.40:15021/healthz/ready": read tcp 10.132.0.2:55680->10.132.0.40:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c23ff1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c23ff1

openshift-ingress

deployment-controller

e2e-inf-b-c23ff1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c23ff1-openshift-default-6b678d6958 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-c23ff1-openshift-default-6b678d6958

SuccessfulCreate

Created pod: e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

openshift-ingress

multus

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c23ff1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c23ff1: serviceaccount "payload-processing-e2e-inf-b-c23ff1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c23ff1: serviceaccount "payload-processing-e2e-inf-b-c23ff1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c23ff1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c23ff1-57c5b7fb9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-083463c6-openshift-default-68f9b5f6bb-5mw7k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083463c6-f65b69cf4-sf427

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-083463c6-699755b9b5-nvcxq

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d

SuccessfulCreate

Created pod: e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

openshift-ingress

deployment-controller

e2e-migrate-dae90c4d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-dae90c4d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-dae90c4d-gw

openshift-ingress

multus

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dae90c4d: serviceaccount "payload-processing-e2e-migrate-dae90c4d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-dae90c4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-dae90c4d-6869947cbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dae90c4d-6869947cbb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dae90c4d-6869947cbb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-dae90c4d-6869947cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dae90c4d: serviceaccount "payload-processing-e2e-migrate-dae90c4d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-dae90c4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-dae90c4d-6869947cbb-dts5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-dae90c4d-gw-openshift-default-784cb9bf4d-h9npg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dae90c4d-69ffddfcfd-6gfxv

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-58050ce1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-58050ce1

openshift-ingress

replicaset-controller

e2e-ait-58050ce1-openshift-default-55cb49df46

SuccessfulCreate

Created pod: e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

openshift-ingress

deployment-controller

e2e-ait-58050ce1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-58050ce1-openshift-default-55cb49df46 from 0 to 1

openshift-ingress

multus

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-58050ce1-95d5d4954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

openshift-ingress

deployment-controller

payload-processing-e2e-ait-58050ce1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-58050ce1-786c65d7cc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-58050ce1-95d5d4954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-58050ce1-95d5d4954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-58050ce1: serviceaccount "payload-processing-e2e-ait-58050ce1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-58050ce1-786c65d7cc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-58050ce1-786c65d7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-58050ce1: serviceaccount "payload-processing-e2e-ait-58050ce1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-58050ce1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-58050ce1-95d5d4954 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-58050ce1-786c65d7cc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-58050ce1-95d5d4954-fxks7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-58050ce1-786c65d7cc-67qdn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-58050ce1-openshift-default-55cb49df46-4hzbj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-f772da8e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f772da8e

openshift-ingress

replicaset-controller

e2e-derive-f772da8e-openshift-default-544465cd44

SuccessfulCreate

Created pod: e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

openshift-ingress

multus

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-f772da8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f772da8e-openshift-default-544465cd44 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f772da8e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f772da8e-7c564565d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f772da8e-7c564565d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f772da8e-7c564565d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f772da8e-7c564565d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f772da8e: serviceaccount "payload-processing-e2e-derive-f772da8e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f772da8e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f772da8e-6d5f6f4f8f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f772da8e: serviceaccount "payload-processing-e2e-derive-f772da8e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f772da8e-7c564565d-22s6s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f772da8e-6d5f6f4f8f-q94d2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a09c2a-7d78799598-srjtt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f772da8e-openshift-default-544465cd44-9ntmk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-a09c2a-6c59646f7c-vmdjm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-bfb318

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-bfb318

openshift-ingress

kubelet

e2e-autores-a09c2a-openshift-default-564444cf78-wvqhd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-bfb318-openshift-default-6bdffbd6d

SuccessfulCreate

Created pod: e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

openshift-ingress

deployment-controller

e2e-explicit-bfb318-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-bfb318-openshift-default-6bdffbd6d from 0 to 1

openshift-ingress

multus

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-bfb318

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bfb318-64d54fc565

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-bfb318-64d54fc565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bfb318: serviceaccount "payload-processing-e2e-explicit-bfb318" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bfb318-64d54fc565

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-bfb318

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-bfb318-64d54fc565 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bfb318: serviceaccount "payload-processing-e2e-explicit-bfb318" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-677907eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-677907eb

openshift-ingress

replicaset-controller

e2e-mt-677907eb-openshift-default-d655f65dd

SuccessfulCreate

Created pod: e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

openshift-ingress

deployment-controller

e2e-mt-677907eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-677907eb-openshift-default-d655f65dd from 0 to 1

openshift-ingress

multus

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-677907eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-677907eb-85cdf7ff9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-677907eb-85cdf7ff9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-677907eb: serviceaccount "payload-processing-e2e-mt-677907eb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-677907eb-85cdf7ff9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-677907eb-85cdf7ff9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-677907eb: serviceaccount "payload-processing-e2e-mt-677907eb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-677907eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-bfb318-64d54fc565-59rrc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-bfb318

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-bfb318: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-bfb318": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-bfb318, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 46b27270-ba2e-4ed0-af06-43652be2dcd4, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bfb318-6b6569bcfd-j5qbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7b8369-9777dbb95-lpp7x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7b8369-68d64bc9b6-sc4ww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-a372ad-openshift-default-c4b8bf48

SuccessfulCreate

Created pod: e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-noten-a372ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a372ad

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-noten-a372ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a372ad-openshift-default-c4b8bf48 from 0 to 1

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-bfb318-openshift-default-6bdffbd6d-p9ghx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.534s (2.534s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-7b8369-openshift-default-c85cbf44d-hlpfd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c23ff1-664f469d6b-w7fdj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c23ff1-57c5b7fb9-vvm48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-131689

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-131689

openshift-ingress

replicaset-controller

e2e-shared-a-w3-131689-openshift-default-6b67897f44

SuccessfulCreate

Created pod: e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

openshift-ingress

deployment-controller

e2e-shared-a-w3-131689-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-131689-openshift-default-6b67897f44 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-c23ff1-openshift-default-6b678d6958-j527p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-131689

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-131689-66476565d7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-131689-66476565d7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-131689-66476565d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-131689: serviceaccount "payload-processing-e2e-shared-a-w3-131689" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-131689: serviceaccount "payload-processing-e2e-shared-a-w3-131689" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-131689

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-131689-66476565d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-677907eb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-677907eb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-677907eb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-677907eb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c4ecaaa2-a76b-40e2-8cb1-07ad576e79ef, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-677907eb-85cdf7ff9c-267vg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-677907eb-6b75cc7c6b-hvgjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-a372ad-openshift-default-c4b8bf48-cx6mj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:36150->10.132.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:36150->10.132.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-677907eb-openshift-default-d655f65dd-25qnl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w2-b0ce96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944

SuccessfulCreate

Created pod: e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-13d59f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-13d59f

openshift-ingress

replicaset-controller

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6

SuccessfulCreate

Created pod: e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

openshift-ingress

multus

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b0ce96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b0ce96

openshift-ingress

deployment-controller

e2e-shared-b-w3-13d59f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-13d59f-openshift-default-84c66846d6 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-13d59f-577b867d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-13d59f-577b867d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-13d59f: serviceaccount "payload-processing-e2e-shared-b-w3-13d59f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-13d59f: serviceaccount "payload-processing-e2e-shared-b-w3-13d59f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-13d59f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-13d59f-577b867d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-13d59f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-13d59f-577b867d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b0ce96: serviceaccount "payload-processing-e2e-shared-a-w2-b0ce96" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b0ce96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b0ce96: serviceaccount "payload-processing-e2e-shared-a-w2-b0ce96" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b0ce96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-008161-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4

SuccessfulCreate

Created pod: e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-008161

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-008161

openshift-ingress

multus

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-008161: serviceaccount "payload-processing-e2e-shared-b-w2-008161" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-008161

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-008161: serviceaccount "payload-processing-e2e-shared-b-w2-008161" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-008161

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-008161-744dc6bcf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-4c4ad334

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4c4ad334

openshift-ingress

deployment-controller

e2e-mt-4c4ad334-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c4ad334-openshift-default-6856fc894d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-4c4ad334-openshift-default-6856fc894d

SuccessfulCreate

Created pod: e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

openshift-ingress

multus

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c4ad334-69558c697c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4c4ad334-69558c697c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c4ad334: serviceaccount "payload-processing-e2e-mt-4c4ad334" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c4ad334-69558c697c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4c4ad334

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4c4ad334-69558c697c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4c4ad334

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c4ad334: serviceaccount "payload-processing-e2e-mt-4c4ad334" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-4c4ad334-69558c697c-sr4db

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c4ad334-dc6fbf878-ttfsk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c4ad334-openshift-default-6856fc894d-6mdrd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-94cf14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-94cf14

openshift-ingress

deployment-controller

e2e-api-a-94cf14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-94cf14-openshift-default-d579fcdc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-94cf14-openshift-default-d579fcdc8

SuccessfulCreate

Created pod: e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

openshift-ingress

multus

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-94cf14: serviceaccount "payload-processing-e2e-api-a-94cf14" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-94cf14-5dffc45ff7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-94cf14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-94cf14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-94cf14-5dffc45ff7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-94cf14-5dffc45ff7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-94cf14-5dffc45ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-94cf14: serviceaccount "payload-processing-e2e-api-a-94cf14" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-07cc17-openshift-default-8496c8c896

SuccessfulCreate

Created pod: e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

openshift-ingress

deployment-controller

e2e-api-b-07cc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-07cc17-openshift-default-8496c8c896 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-07cc17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-07cc17

openshift-ingress

multus

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-07cc17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-07cc17-6b845757d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-07cc17-6c9c59b775

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-07cc17-6c9c59b775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-07cc17: serviceaccount "payload-processing-e2e-api-b-07cc17" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-07cc17-6c9c59b775

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-07cc17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-07cc17-6c9c59b775 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-07cc17-6b845757d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-07cc17-6b845757d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-07cc17: serviceaccount "payload-processing-e2e-api-b-07cc17" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-07cc17-6b845757d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-94cf14

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-94cf14: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-94cf14": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-94cf14, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1c29a0fe-42de-4d1b-bcd3-6ba248317a68, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-94cf14-7d4cb55fbb-5dzvc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-94cf14-5dffc45ff7-q96vv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-94cf14-openshift-default-d579fcdc8-9h4z6

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-07cc17

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-07cc17: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-07cc17": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-07cc17, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f02f901a-479d-419f-9e51-07c863917c87, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-07cc17-6b845757d-669zt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-07cc17-6c9c59b775-wpdq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-07cc17-openshift-default-8496c8c896-229lr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0ce96-684b9c9f79-ln4k7

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-b0ce96

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b0ce96: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-b0ce96": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b0ce96, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7838e1e6-ef1b-493f-9c42-a72f5d08c476, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0ce96-7998f89d4b-v2jcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b0ce96-openshift-default-bfcc9d944-2lwbv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-008161-744dc6bcf9-44clt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-008161-84f7cd57d-2tqwt

Unhealthy

Readiness probe failed: dial tcp 10.134.0.60:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-008161-openshift-default-7c7fcd86d4-wg9ww

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6

SuccessfulCreate

Created pod: e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

openshift-ingress

deployment-controller

e2e-ipp-a-8cc2d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8cc2d6-openshift-default-8b66764d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8cc2d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8cc2d6

openshift-ingress

multus

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6: serviceaccount "payload-processing-e2e-ipp-a-8cc2d6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8cc2d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8cc2d6: serviceaccount "payload-processing-e2e-ipp-a-8cc2d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8cc2d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:42566->10.133.0.75:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:42566->10.133.0.75:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-b99260-openshift-default-cbd869448

SuccessfulCreate

Created pod: e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

openshift-ingress

deployment-controller

e2e-ipp-b-b99260-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b99260-openshift-default-cbd869448 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b99260

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b99260

openshift-ingress

multus

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b99260-bc74f58f5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b99260

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b99260-bc74f58f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b99260-bc74f58f5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b99260-bc74f58f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b99260: serviceaccount "payload-processing-e2e-ipp-b-b99260" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b99260

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b99260: serviceaccount "payload-processing-e2e-ipp-b-b99260" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648

SuccessfulCreate

Created pod: e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

openshift-ingress

deployment-controller

e2e-ipp-cleanup-6ddd57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-6ddd57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-6ddd57

openshift-ingress

multus

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-6ddd57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-6ddd57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57: serviceaccount "payload-processing-e2e-ipp-cleanup-6ddd57" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6ddd57: serviceaccount "payload-processing-e2e-ipp-cleanup-6ddd57" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6ddd57-65fd6c5746-t8hx5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6ddd57-7f548997f9-nfvbg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-6ddd57-openshift-default-6b4776f648-nh49v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8cc2d6-6b69d4bfd5-wrrz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8cc2d6-68f89c5558-j74kk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-8cc2d6-openshift-default-8b66764d6-8gbjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b99260-5b4bbd77c8-sfbzd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b99260-bc74f58f5-nxd6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b99260-openshift-default-cbd869448-pd6gt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-131689-66476565d7-pvwm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-131689-56d894f5f4-8jjfn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-131689

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-131689: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-131689": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-131689, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 97f37c55-7dba-44b6-a5c9-0ebed0be5c31, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-131689-openshift-default-6b67897f44-29685

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13d59f-577b867d9-pm96r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13d59f-8489f9dcf8-9xjcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-13d59f-openshift-default-84c66846d6-z7fh6

Killing

Stopping container istio-proxy