Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4 to ip-10-0-128-32.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf to ip-10-0-141-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286 to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Scheduled

Successfully assigned openshift-ingress/e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6 to ip-10-0-141-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-72563d-556c84c889-vx8b2 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46 to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f486484c-openshift-default-7669d8648-sjc52 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6vxmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6vxmn to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284 to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj to ip-10-0-141-117.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2pxrz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2pxrz to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn to ip-10-0-128-32.ec2.internal

openshift-ingress

router-default-67c5f4dcb-cnpgt

Scheduled

Successfully assigned openshift-ingress/router-default-67c5f4dcb-cnpgt to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45 to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89 to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p to ip-10-0-134-172.ec2.internal

openshift-ingress

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8 to ip-10-0-128-32.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls to ip-10-0-134-172.ec2.internal

openshift-ingress

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Scheduled

Successfully assigned openshift-ingress/e2e-autores-63d928-openshift-default-6565cd9666-w7r79 to ip-10-0-134-172.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-ljj6v

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-ljj6v to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9 to ip-10-0-134-172.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-9xxg2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9xxg2 to ip-10-0-134-172.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9lq5z to ip-10-0-141-117.ec2.internal

openshift-ingress

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns to ip-10-0-141-117.ec2.internal

openshift-ingress

kube-auth-proxy-c4db4689d-7q5ms

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-c4db4689d-7q5ms to ip-10-0-128-32.ec2.internal

openshift-ingress

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg to ip-10-0-128-32.ec2.internal

openshift-ingress

kube-auth-proxy-c4db4689d-r4bvs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-c4db4689d-r4bvs to ip-10-0-134-172.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-67c5f4dcb from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-67c5f4dcb

FailedCreate

Error creating: pods "router-default-67c5f4dcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-67c5f4dcb

FailedCreate

Error creating: pods "router-default-67c5f4dcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-67c5f4dcb

SuccessfulCreate

Created pod: router-default-67c5f4dcb-cnpgt
(x5)

openshift-ingress

kubelet

router-default-67c5f4dcb-cnpgt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-67c5f4dcb-cnpgt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-67c5f4dcb-cnpgt

Started

Started container router

openshift-ingress

kubelet

router-default-67c5f4dcb-cnpgt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-67c5f4dcb-cnpgt

AddedInterface

Add eth0 [10.133.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-67c5f4dcb-cnpgt

Created

Created container: router

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-7q5ms

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-r4bvs

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-c4db4689d

SuccessfulCreate

Created pod: kube-auth-proxy-c4db4689d-r4bvs

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-c4db4689d from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-c4db4689d

SuccessfulCreate

Created pod: kube-auth-proxy-c4db4689d-7q5ms
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-c4db4689d

FailedCreate

Error creating: pods "kube-auth-proxy-c4db4689d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-r4bvs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-c4db4689d-r4bvs

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-c4db4689d-7q5ms

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-7q5ms

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-9xxg2

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-9xxg2

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-7q5ms

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-7q5ms

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-7q5ms

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.137s (3.137s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-r4bvs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.292s (4.292s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-r4bvs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.673s (3.673s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-c4db4689d-r4bvs

Created

Created container: kube-auth-proxy
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.898s (2.898s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5nzkf

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ljj6v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-ljj6v

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-ljj6v

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ljj6v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.278s (2.278s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ljj6v

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ljj6v

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9xxg2

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-9xxg2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9lq5z

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6vxmn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2pxrz
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2pxrz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-2pxrz

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6vxmn

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6vxmn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6vxmn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6vxmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6vxmn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.8s (1.8s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2pxrz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.76s (1.76s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2pxrz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2pxrz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9lq5z

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-a64414-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a64414-openshift-default-6f7d67476b from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-a64414

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-a64414-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-a64414-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-a-a64414-openshift-default-6f7d67476b

SuccessfulCreate

Created pod: e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a64414

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a64414

openshift-ingress

multus

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a64414: serviceaccount "payload-processing-e2e-inf-a-a64414" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a64414

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a64414

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a64414-7c44c445f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a64414-7c44c445f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a64414-7c44c445f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a64414-7c44c445f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a64414: serviceaccount "payload-processing-e2e-inf-a-a64414" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-921d8a5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-921d8a5d

openshift-ingress

replicaset-controller

e2e-ait-921d8a5d-openshift-default-d78cdcb64

SuccessfulCreate

Created pod: e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

openshift-ingress

deployment-controller

e2e-ait-921d8a5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-921d8a5d-openshift-default-d78cdcb64 from 0 to 1

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-63d928

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-63d928

openshift-ingress

deployment-controller

e2e-autores-63d928-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-63d928-openshift-default-6565cd9666 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-63d928-openshift-default-6565cd9666

SuccessfulCreate

Created pod: e2e-autores-63d928-openshift-default-6565cd9666-w7r79

openshift-ingress

multus

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.406s (2.406s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-63d928-6d65b6448f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-63d928-6d65b6448f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-63d928: serviceaccount "payload-processing-e2e-autores-63d928" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-63d928-5cd984d74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-63d928-5cd984d74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-63d928-5cd984d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-63d928: serviceaccount "payload-processing-e2e-autores-63d928" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-63d928

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-63d928-5cd984d74 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-autores-63d928

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-63d928-6d65b6448f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-63d928-6d65b6448f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 12.13s (12.13s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

openshift-ingress

kubelet

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-921d8a5d: serviceaccount "payload-processing-e2e-ait-921d8a5d" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-921d8a5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-921d8a5d-7c6478769d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-921d8a5d: serviceaccount "payload-processing-e2e-ait-921d8a5d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-921d8a5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-921d8a5d-6cd67d7fdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4fd6f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4fd6f6

openshift-ingress

deployment-controller

e2e-inf-b-4fd6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6 from 0 to 1

openshift-ingress

multus

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6

SuccessfulCreate

Created pod: e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9
(x2)

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": read tcp 10.134.0.2:46808->10.134.0.30:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": read tcp 10.134.0.2:46808->10.134.0.30:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4fd6f6-749d7b778c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4fd6f6-749d7b778c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4fd6f6: serviceaccount "payload-processing-e2e-inf-b-4fd6f6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4fd6f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4fd6f6-749d7b778c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4fd6f6-749d7b778c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4fd6f6: serviceaccount "payload-processing-e2e-inf-b-4fd6f6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4fd6f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.243s (3.243s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-921d8a5d-6cd67d7fdc-7h8f8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-921d8a5d-7c6478769d-jnp46

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-921d8a5d-openshift-default-d78cdcb64-vrrft

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-4cc4c1dc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4cc4c1dc-gw

openshift-ingress

deployment-controller

e2e-migrate-4cc4c1dc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8

SuccessfulCreate

Created pod: e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

openshift-ingress

multus

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4cc4c1dc: serviceaccount "payload-processing-e2e-migrate-4cc4c1dc" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4cc4c1dc: serviceaccount "payload-processing-e2e-migrate-4cc4c1dc" not found

openshift-ingress

multus

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4cc4c1dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4cc4c1dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-4cc4c1dc-gw-openshift-default-645fbf4bb8-lwp8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc4c1dc-7569bd7c4-flfss

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc4c1dc-5887774b66-4928p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-63d928-5cd984d74-g5qvr

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-63d928

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-63d928: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-63d928": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-63d928, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 93759e8a-a49b-476b-afd4-6603a24c1a11, UID in object meta:

openshift-ingress

replicaset-controller

e2e-ait-e8480dce-openshift-default-5df6869cc4

SuccessfulCreate

Created pod: e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

openshift-ingress

deployment-controller

e2e-ait-e8480dce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e8480dce-openshift-default-5df6869cc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e8480dce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e8480dce

openshift-ingress

kubelet

payload-processing-e2e-autores-63d928-6d65b6448f-9rvnn

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8480dce: serviceaccount "payload-processing-e2e-ait-e8480dce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e8480dce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8480dce-58489f8db9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8480dce-58489f8db9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e8480dce-58489f8db9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8480dce: serviceaccount "payload-processing-e2e-ait-e8480dce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e8480dce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e8480dce-58489f8db9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-autores-63d928-openshift-default-6565cd9666-w7r79

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-72563d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-72563d

openshift-ingress

replicaset-controller

e2e-explicit-72563d-openshift-default-65fcf874bd

SuccessfulCreate

Created pod: e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

openshift-ingress

deployment-controller

e2e-explicit-72563d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-72563d-openshift-default-65fcf874bd from 0 to 1

openshift-ingress

multus

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-72563d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-72563d-556c84c889 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-72563d-85bb7795d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-72563d-85bb7795d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-72563d: serviceaccount "payload-processing-e2e-explicit-72563d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-72563d-556c84c889

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

openshift-ingress

multus

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-72563d-556c84c889

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-72563d-556c84c889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-72563d: serviceaccount "payload-processing-e2e-explicit-72563d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-72563d-85bb7795d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-72563d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-72563d-85bb7795d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8480dce-b9f4dbcf4-gsd84

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-e8480dce

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-e8480dce: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-e8480dce": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-e8480dce, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0b133d88-698b-4547-91d6-fd987cba8e82, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-e8480dce-58489f8db9-2ssd7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e8480dce-openshift-default-5df6869cc4-5lpnm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-derive-8e65e509-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8e65e509-openshift-default-7ccf4fd8f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6

SuccessfulCreate

Created pod: e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

openshift-ingress

multus

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-derive-8e65e509

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-8e65e509-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-8e65e509-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-derive-8e65e509

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8e65e509

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8e65e509

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8e65e509-69ddf57949

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8e65e509-69ddf57949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8e65e509: serviceaccount "payload-processing-e2e-derive-8e65e509" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8e65e509: serviceaccount "payload-processing-e2e-derive-8e65e509" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8e65e509

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8e65e509-69ddf57949 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8e65e509-69ddf57949

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

openshift-ingress

multus

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-8e65e509-openshift-default-7ccf4fd8f6-knf2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-8e65e509-69ddf57949-hkkmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e65e509-6ff98d9ddb-6cr8v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-72563d-556c84c889-vx8b2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72563d-85bb7795d-4vlxb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-72563d-openshift-default-65fcf874bd-dbrhg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-c72d2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c72d2b

openshift-ingress

deployment-controller

e2e-noten-c72d2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c72d2b-openshift-default-75b879dc64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-c72d2b-openshift-default-75b879dc64

SuccessfulCreate

Created pod: e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

openshift-ingress

GatewayAuthBootstrap

e2e-noten-c72d2b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-c72d2b-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-c72d2b-authn-ssl" already exists

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-c72d2b-openshift-default-75b879dc64-4zgtf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a64414-7c44c445f7-5zxh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a64414-5b5bc69b9d-nfjxp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-a64414-openshift-default-6f7d67476b-7nrns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4fd6f6-749d7b778c-vgqcr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-4fd6f6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-4fd6f6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-4fd6f6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-4fd6f6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6b2fa969-a526-4d39-9a19-f5becea58e28, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4fd6f6-55d8989bb-mwnfb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-4fd6f6-openshift-default-756d8b8fc6-tq8b9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-9ec1e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-9ec1e5-openshift-default-79964db456 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-9ec1e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9ec1e5

openshift-ingress

multus

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456

SuccessfulCreate

Created pod: e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-9ec1e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-9ec1e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ec1e5: serviceaccount "payload-processing-e2e-shared-a-w3-9ec1e5" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ec1e5: serviceaccount "payload-processing-e2e-shared-a-w3-9ec1e5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-f486484c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f486484c

openshift-ingress

deployment-controller

e2e-mt-f486484c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f486484c-openshift-default-7669d8648 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f486484c-openshift-default-7669d8648

SuccessfulCreate

Created pod: e2e-mt-f486484c-openshift-default-7669d8648-sjc52

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f486484c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f486484c-8b778f97c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f486484c-974f796b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

openshift-ingress

kubelet

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f486484c-974f796b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f486484c-974f796b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f486484c: serviceaccount "payload-processing-e2e-mt-f486484c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f486484c-8b778f97c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f486484c-8b778f97c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f486484c: serviceaccount "payload-processing-e2e-mt-f486484c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f486484c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f486484c-974f796b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f486484c-8b778f97c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

openshift-ingress

kubelet

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": read tcp 10.133.0.2:55874->10.133.0.70:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": read tcp 10.133.0.2:55874->10.133.0.70:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d

SuccessfulCreate

Created pod: e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

openshift-ingress

deployment-controller

e2e-shared-b-w3-146c0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-146c0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-146c0e

openshift-ingress

multus

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-146c0e-d754d8999

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-146c0e: serviceaccount "payload-processing-e2e-shared-b-w3-146c0e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-146c0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-146c0e-d754d8999

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-146c0e-d754d8999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-146c0e: serviceaccount "payload-processing-e2e-shared-b-w3-146c0e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-146c0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-146c0e-d754d8999 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f486484c-8b778f97c-d6sbg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f486484c-974f796b6-v4284

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-f486484c-openshift-default-7669d8648-sjc52

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68

SuccessfulCreate

Created pod: e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

openshift-ingress

multus

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-ed43d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ed43d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ed43d3

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed43d3: serviceaccount "payload-processing-e2e-shared-a-w2-ed43d3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ed43d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed43d3: serviceaccount "payload-processing-e2e-shared-a-w2-ed43d3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ed43d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-217ad6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-217ad6

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-217ad6

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-217ad6-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-217ad6-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74

SuccessfulCreate

Created pod: e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

openshift-ingress

deployment-controller

e2e-shared-b-w2-217ad6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-217ad6-openshift-default-79b9799b74 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-217ad6-668794485c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-217ad6-668794485c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-217ad6: serviceaccount "payload-processing-e2e-shared-b-w2-217ad6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-217ad6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-217ad6: serviceaccount "payload-processing-e2e-shared-b-w2-217ad6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-217ad6-668794485c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-217ad6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-217ad6-668794485c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.866s (1.866s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6

SuccessfulCreate

Created pod: e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

openshift-ingress

deployment-controller

e2e-mt-9f64c8d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9f64c8d3-openshift-default-786dfdc6f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-9f64c8d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9f64c8d3

openshift-ingress

multus

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

openshift-ingress

multus

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f64c8d3: serviceaccount "payload-processing-e2e-mt-9f64c8d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9f64c8d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9f64c8d3-56578d957d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f64c8d3: serviceaccount "payload-processing-e2e-mt-9f64c8d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9f64c8d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9f64c8d3-566cbf5fc7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-9f64c8d3-566cbf5fc7-6h5t7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f64c8d3-56578d957d-8gz89

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-9f64c8d3-openshift-default-786dfdc6f6-4g2x4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-17eaa7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-17eaa7

openshift-ingress

deployment-controller

e2e-api-a-17eaa7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-17eaa7-openshift-default-797d8bcfb8 from 0 to 1

openshift-ingress

multus

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-17eaa7-openshift-default-797d8bcfb8

SuccessfulCreate

Created pod: e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-17eaa7: serviceaccount "payload-processing-e2e-api-a-17eaa7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-17eaa7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-17eaa7-5dd57b7d7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-17eaa7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-17eaa7: serviceaccount "payload-processing-e2e-api-a-17eaa7" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-9b6db4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9b6db4-openshift-default-5d94699676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9b6db4-openshift-default-5d94699676

SuccessfulCreate

Created pod: e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

openshift-ingress

gateway_labeler_controller

e2e-api-b-9b6db4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9b6db4

openshift-ingress

multus

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9b6db4-5668757455

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9b6db4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9b6db4: serviceaccount "payload-processing-e2e-api-b-9b6db4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9b6db4-5668757455

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9b6db4-5668757455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9b6db4: serviceaccount "payload-processing-e2e-api-b-9b6db4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9b6db4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9b6db4-5668757455 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-17eaa7-5dd57b7d7f-tlx45

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17eaa7-df8fdd55d-7js5v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-17eaa7-openshift-default-797d8bcfb8-6thr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-9b6db4-5668757455-f8bcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9b6db4-5f564f7f7d-g96g9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9b6db4-openshift-default-5d94699676-bttdn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-3543cf-openshift-default-6f7789d64b

SuccessfulCreate

Created pod: e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

openshift-ingress

deployment-controller

e2e-ipp-a-3543cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3543cf-openshift-default-6f7789d64b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3543cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3543cf

openshift-ingress

multus

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3543cf: serviceaccount "payload-processing-e2e-ipp-a-3543cf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3543cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3543cf-769c5ff549 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3543cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3543cf-bd665b946 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed43d3-868c9c7d75-5hxcb

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3543cf-769c5ff549

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3543cf-769c5ff549

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3543cf-769c5ff549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3543cf: serviceaccount "payload-processing-e2e-ipp-a-3543cf" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed43d3-6db947b9d6-jkpvb

Unhealthy

Readiness probe failed: dial tcp 10.133.0.75:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-ed43d3-openshift-default-84765cbc68-ljvxg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-217ad6-668794485c-55sbj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-217ad6-86455cd58-cv286

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-217ad6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-217ad6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-217ad6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-217ad6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 17ca42e4-13b4-4b7e-94ed-c70e769b8e49, UID in object meta:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-bb64b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-bb64b4

openshift-ingress

replicaset-controller

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb

SuccessfulCreate

Created pod: e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

openshift-ingress

deployment-controller

e2e-ipp-b-bb64b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-217ad6-openshift-default-79b9799b74-b6k4g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

openshift-ingress

multus

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-bb64b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bb64b4: serviceaccount "payload-processing-e2e-ipp-b-bb64b4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-bb64b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bb64b4: serviceaccount "payload-processing-e2e-ipp-b-bb64b4" not found

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-23158b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-23158b-openshift-default-64879469d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-23158b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-23158b

openshift-ingress

multus

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-23158b-openshift-default-64879469d6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-23158b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-23158b: serviceaccount "payload-processing-e2e-ipp-cleanup-23158b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-23158b: serviceaccount "payload-processing-e2e-ipp-cleanup-23158b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-23158b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-23158b-f76cfb4bb-fklc6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-23158b-5fb5bff869-2qwtt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-23158b-openshift-default-64879469d6-lmkhn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3543cf-bd665b946-grfth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3543cf-769c5ff549-m882f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3543cf-openshift-default-6f7789d64b-hr7fs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bb64b4-6b45ff4d4c-9bxsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bb64b4-9b8875c46-kvtcb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-bb64b4-openshift-default-6b8bc599fb-7xrkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ec1e5-7ff5d6c455-ghhhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ec1e5-8696dbbd4b-ggbr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-9ec1e5-openshift-default-79964db456-cdgkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-146c0e-d754d8999-8dxls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-146c0e-565d679794-5vkp9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-146c0e-openshift-default-cf9d4646d-cdsns

Killing

Stopping container istio-proxy