Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4 to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-21049c60-8855d48b5-lt89j to ip-10-0-128-141.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mrcfl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mrcfl to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7 to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2 to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl to ip-10-0-128-141.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wm95m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wm95m to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Scheduled

Successfully assigned openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7 to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5 to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5 to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh to ip-10-0-132-83.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66 to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96 to ip-10-0-132-244.ec2.internal

openshift-ingress

router-default-77578d5fdb-w9ttn

Scheduled

Successfully assigned openshift-ingress/router-default-77578d5fdb-w9ttn to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7 to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f17132d8-openshift-default-7954847856-fm6vk to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-7tzk2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-7tzk2 to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br to ip-10-0-132-83.ec2.internal

openshift-ingress

kube-auth-proxy-849fd8447d-jw84c

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-849fd8447d-jw84c to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf to ip-10-0-132-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55 to ip-10-0-132-83.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kvtb6 to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 to ip-10-0-132-244.ec2.internal

openshift-ingress

kube-auth-proxy-849fd8447d-n2lrt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-849fd8447d-n2lrt to ip-10-0-128-141.ec2.internal

openshift-ingress

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck to ip-10-0-128-141.ec2.internal

openshift-ingress

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-z44zd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-z44zd to ip-10-0-132-83.ec2.internal

openshift-ingress

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh to ip-10-0-132-83.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-77578d5fdb from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-77578d5fdb

FailedCreate

Error creating: pods "router-default-77578d5fdb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-77578d5fdb

FailedCreate

Error creating: pods "router-default-77578d5fdb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-77578d5fdb

SuccessfulCreate

Created pod: router-default-77578d5fdb-w9ttn
(x5)

openshift-ingress

kubelet

router-default-77578d5fdb-w9ttn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-77578d5fdb-w9ttn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-77578d5fdb-w9ttn

Started

Started container router

openshift-ingress

multus

router-default-77578d5fdb-w9ttn

AddedInterface

Add eth0 [10.133.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-77578d5fdb-w9ttn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-77578d5fdb-w9ttn

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-849fd8447d from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-849fd8447d

FailedCreate

Error creating: pods "kube-auth-proxy-849fd8447d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-849fd8447d

SuccessfulCreate

Created pod: kube-auth-proxy-849fd8447d-jw84c

openshift-ingress

replicaset-controller

kube-auth-proxy-849fd8447d

SuccessfulCreate

Created pod: kube-auth-proxy-849fd8447d-n2lrt

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-n2lrt

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-jw84c

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-849fd8447d-jw84c

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wm95m

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-n2lrt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-849fd8447d-n2lrt

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wm95m

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wm95m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-jw84c

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-jw84c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.708s (2.708s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-jw84c

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-n2lrt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.477s (2.477s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-n2lrt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-849fd8447d-n2lrt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wm95m

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wm95m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.451s (2.451s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wm95m

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.825s (4.825s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mrcfl

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mrcfl

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mrcfl

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mrcfl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mrcfl

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wm95m

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wm95m

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-kvtb6

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.574s (2.574s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-z44zd
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-7tzk2

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z44zd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-z44zd

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tzk2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-7tzk2

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tzk2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.45s (1.45s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z44zd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.437s (1.437s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tzk2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z44zd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z44zd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7tzk2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kvtb6

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-036fc2-openshift-default-64b6bd5b86

SuccessfulCreate

Created pod: e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-a02b2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-a02b2c

openshift-ingress

deployment-controller

e2e-worker-w4-a02b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a02b2c-openshift-default-5599fcbf68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-40970f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-40970f

openshift-ingress

deployment-controller

e2e-worker-w0-40970f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-40970f-openshift-default-8558cc99b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68

SuccessfulCreate

Created pod: e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

openshift-ingress

deployment-controller

e2e-inf-a-036fc2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-036fc2-openshift-default-64b6bd5b86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-036fc2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-036fc2

openshift-ingress

replicaset-controller

e2e-worker-w0-40970f-openshift-default-8558cc99b8

SuccessfulCreate

Created pod: e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

openshift-ingress

multus

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-a02b2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-a02b2c-ddd696947 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a02b2c: serviceaccount "payload-processing-e2e-worker-w4-a02b2c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-a02b2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a02b2c-ddd696947

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-a02b2c-ddd696947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a02b2c: serviceaccount "payload-processing-e2e-worker-w4-a02b2c" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a02b2c-ddd696947

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-40970f: serviceaccount "payload-processing-e2e-worker-w0-40970f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-40970f-6f5b777875

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-40970f-6f5b777875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-40970f: serviceaccount "payload-processing-e2e-worker-w0-40970f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-40970f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-40970f-65466d45bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-40970f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-40970f-6f5b777875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-40970f-6f5b777875

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-036fc2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-036fc2-567d6f6f6f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-036fc2-567d6f6f6f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-036fc2-567d6f6f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-036fc2: serviceaccount "payload-processing-e2e-inf-a-036fc2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-036fc2-567d6f6f6f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.418s (1.418s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-036fc2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-036fc2-977f895bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-036fc2-977f895bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-036fc2-977f895bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-036fc2: serviceaccount "payload-processing-e2e-inf-a-036fc2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-036fc2-977f895bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-13658e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-13658e-openshift-default-b456f7846 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-13658e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-13658e

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-13658e-openshift-default-b456f7846

SuccessfulCreate

Created pod: e2e-autores-13658e-openshift-default-b456f7846-hqlkq

openshift-ingress

multus

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-57fc5a8f-openshift-default-568ff6c57d

SuccessfulCreate

Created pod: e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

openshift-ingress

deployment-controller

e2e-ait-57fc5a8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-57fc5a8f-openshift-default-568ff6c57d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-57fc5a8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-57fc5a8f

openshift-ingress

kubelet

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.22s (2.22s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-13658e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-13658e-5577dc6946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-13658e-5577dc6946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-13658e-5577dc6946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-13658e-5577dc6946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-13658e: serviceaccount "payload-processing-e2e-autores-13658e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-13658e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-13658e-69d54bf9b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-13658e-69d54bf9b5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-13658e-69d54bf9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-13658e: serviceaccount "payload-processing-e2e-autores-13658e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-13658e-69d54bf9b5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-57fc5a8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-57fc5a8f-7b64f6895c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-57fc5a8f: serviceaccount "payload-processing-e2e-ait-57fc5a8f" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-57fc5a8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-57fc5a8f-7b64f6895c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-57fc5a8f-7b64f6895c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-57fc5a8f-7b64f6895c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-57fc5a8f: serviceaccount "payload-processing-e2e-ait-57fc5a8f" not found

openshift-ingress

multus

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-12afdd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-12afdd-openshift-default-7b9fb7c896 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-12afdd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-12afdd

openshift-ingress

replicaset-controller

e2e-inf-b-12afdd-openshift-default-7b9fb7c896

SuccessfulCreate

Created pod: e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

openshift-ingress

multus

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12afdd: serviceaccount "payload-processing-e2e-inf-b-12afdd" not found
(x6)

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-12afdd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-12afdd-69cdc7bbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-12afdd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-12afdd-546644b6c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12afdd: serviceaccount "payload-processing-e2e-inf-b-12afdd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d
(x2)

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-57fc5a8f-7b64f6895c-t8tck

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-57fc5a8f-6d8d577686-96d2b

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-850ecce6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-850ecce6-gw

openshift-ingress

deployment-controller

e2e-migrate-850ecce6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56

SuccessfulCreate

Created pod: e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

openshift-ingress

multus

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-850ecce6-d6459965d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-850ecce6-754d9b9478

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-850ecce6-754d9b9478

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-850ecce6-754d9b9478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-850ecce6: serviceaccount "payload-processing-e2e-migrate-850ecce6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-850ecce6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-850ecce6-754d9b9478 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-850ecce6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-850ecce6-d6459965d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-850ecce6-d6459965d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-850ecce6-d6459965d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-850ecce6: serviceaccount "payload-processing-e2e-migrate-850ecce6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-850ecce6-754d9b9478-q2bdn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8a84bc4e-openshift-default-c644f4f8b

SuccessfulCreate

Created pod: e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

openshift-ingress

deployment-controller

e2e-ait-8a84bc4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8a84bc4e-openshift-default-c644f4f8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8a84bc4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8a84bc4e

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8a84bc4e: serviceaccount "payload-processing-e2e-ait-8a84bc4e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8a84bc4e: serviceaccount "payload-processing-e2e-ait-8a84bc4e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8a84bc4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8a84bc4e-669bfd9f9c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8a84bc4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8a84bc4e-5978c48b5d-mplc7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-8a84bc4e-openshift-default-c644f4f8b-qr5qs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-21049c60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-21049c60

openshift-ingress

deployment-controller

e2e-derive-21049c60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-21049c60-openshift-default-5d96b56c76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-21049c60-openshift-default-5d96b56c76

SuccessfulCreate

Created pod: e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

openshift-ingress

multus

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-21049c60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-21049c60-56799bf8db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-21049c60-8855d48b5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-21049c60-8855d48b5-lt89j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-21049c60-8855d48b5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-21049c60-8855d48b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-21049c60: serviceaccount "payload-processing-e2e-derive-21049c60" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-21049c60-56799bf8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-21049c60-56799bf8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-21049c60-56799bf8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-21049c60: serviceaccount "payload-processing-e2e-derive-21049c60" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-21049c60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-21049c60-8855d48b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-13658e-69d54bf9b5-j4bht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-13658e-5577dc6946-z7mgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21049c60-56799bf8db-gkjfh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-21049c60-8855d48b5-lt89j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-13658e-openshift-default-b456f7846-hqlkq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-ec85d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ec85d5

openshift-ingress

deployment-controller

e2e-explicit-ec85d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ec85d5-openshift-default-55d4b885b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-ec85d5-openshift-default-55d4b885b8

SuccessfulCreate

Created pod: e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

openshift-ingress

multus

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ec85d5: serviceaccount "payload-processing-e2e-explicit-ec85d5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ec85d5-7d8b4d9845

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ec85d5-7d8b4d9845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ec85d5: serviceaccount "payload-processing-e2e-explicit-ec85d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ec85d5-7d8b4d9845

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ec85d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ec85d5-7d8b4d9845 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ec85d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ec85d5-5f685474fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-f17132d8-openshift-default-7954847856

SuccessfulCreate

Created pod: e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

openshift-ingress

deployment-controller

e2e-mt-f17132d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f17132d8-openshift-default-7954847856 from 0 to 1

openshift-ingress

multus

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-f17132d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f17132d8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f17132d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f17132d8-587ff8cf98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f17132d8: serviceaccount "payload-processing-e2e-mt-f17132d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f17132d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f17132d8-78bbbf999c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f17132d8-78bbbf999c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f17132d8-78bbbf999c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f17132d8-78bbbf999c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f17132d8: serviceaccount "payload-processing-e2e-mt-f17132d8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-f17132d8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-f17132d8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-f17132d8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-f17132d8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94390bc4-ef16-41ba-bc0b-06104b148570, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-f17132d8-78bbbf999c-t9jvg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-mt-f17132d8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-mt-f17132d8: Operation cannot be fulfilled on endpoints "payload-processing-e2e-mt-f17132d8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-mt-f17132d8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 21a40645-d3a8-4b4e-a577-72410a4f4466, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f17132d8-587ff8cf98-np7p7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f17132d8-openshift-default-7954847856-fm6vk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-ec85d5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-ec85d5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-ec85d5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-ec85d5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8acbaae5-87ac-41dc-a846-43f07c63142e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ec85d5-5f685474fd-g8cbt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ec85d5-7d8b4d9845-4qltg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-d4e72b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8

SuccessfulCreate

Created pod: e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-d4e72b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-d4e72b-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-d4e72b-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-d4e72b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-d4e72b

openshift-ingress

multus

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-d4e72b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d4e72b: serviceaccount "payload-processing-e2e-shared-a-w2-d4e72b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d4e72b: serviceaccount "payload-processing-e2e-shared-a-w2-d4e72b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-d4e72b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

Started

Started container payload-processing

openshift-ingress

multus

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-3b3206

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3b3206

openshift-ingress

replicaset-controller

e2e-noten-3b3206-openshift-default-5bb749758d

SuccessfulCreate

Created pod: e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-3b3206-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3b3206-openshift-default-5bb749758d from 0 to 1

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb

SuccessfulCreate

Created pod: e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-75dcf1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-75dcf1

openshift-ingress

deployment-controller

e2e-shared-b-w2-75dcf1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-75dcf1-openshift-default-65894767fb from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-75dcf1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-75dcf1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-75dcf1: serviceaccount "payload-processing-e2e-shared-b-w2-75dcf1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-75dcf1: serviceaccount "payload-processing-e2e-shared-b-w2-75dcf1" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-31cca2d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-31cca2d1

openshift-ingress

replicaset-controller

e2e-mt-31cca2d1-openshift-default-84dd4d9944

SuccessfulCreate

Created pod: e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

openshift-ingress

deployment-controller

e2e-mt-31cca2d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-31cca2d1-openshift-default-84dd4d9944 from 0 to 1

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-31cca2d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-31cca2d1-76f5cc6857 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-31cca2d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-31cca2d1: serviceaccount "payload-processing-e2e-mt-31cca2d1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-31cca2d1-76f5cc6857

FailedCreate

Error creating: pods "payload-processing-e2e-mt-31cca2d1-76f5cc6857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-31cca2d1: serviceaccount "payload-processing-e2e-mt-31cca2d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-31cca2d1-76f5cc6857

SuccessfulCreate

Created pod: payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

openshift-ingress

kubelet

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-036fc2-977f895bb-bgldj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-036fc2-openshift-default-64b6bd5b86-dv46w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12afdd-69cdc7bbb7-bgk8d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-12afdd-openshift-default-7b9fb7c896-z4l2g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454

SuccessfulCreate

Created pod: e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

openshift-ingress

deployment-controller

e2e-shared-a-w3-d25bfb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d25bfb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d25bfb

openshift-ingress

multus

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d25bfb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d25bfb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb: serviceaccount "payload-processing-e2e-shared-a-w3-d25bfb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d25bfb: serviceaccount "payload-processing-e2e-shared-a-w3-d25bfb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd

SuccessfulCreate

Created pod: e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

openshift-ingress

deployment-controller

e2e-shared-b-w3-d634d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-d634d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-d634d2

openshift-ingress

multus

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Created

Created container: istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2: serviceaccount "payload-processing-e2e-shared-b-w3-d634d2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d634d2: serviceaccount "payload-processing-e2e-shared-b-w3-d634d2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-d634d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-d634d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-31cca2d1-6575d4cbb-fpf8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-31cca2d1-76f5cc6857-7kb2d

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-7b5a6c-openshift-default-bc6449596

SuccessfulCreate

Created pod: e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

openshift-ingress

gateway_labeler_controller

e2e-api-a-7b5a6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7b5a6c

openshift-ingress

deployment-controller

e2e-api-a-7b5a6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7b5a6c-openshift-default-bc6449596 from 0 to 1

openshift-ingress

multus

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7b5a6c: serviceaccount "payload-processing-e2e-api-a-7b5a6c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7b5a6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7b5a6c-749c784c95

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7b5a6c-749c784c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7b5a6c: serviceaccount "payload-processing-e2e-api-a-7b5a6c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7b5a6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7b5a6c-749c784c95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7b5a6c-749c784c95

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

openshift-ingress

multus

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

Created

Created container: payload-processing

openshift-ingress

multus

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-3c1586-openshift-default-77676bc5f4

SuccessfulCreate

Created pod: e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

openshift-ingress

deployment-controller

e2e-api-b-3c1586-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3c1586-openshift-default-77676bc5f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-3c1586

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3c1586
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3c1586-67f84785fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3c1586-67f84785fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3c1586: serviceaccount "payload-processing-e2e-api-b-3c1586" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3c1586

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3c1586-f8f54bf89 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3c1586-f8f54bf89

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3c1586-67f84785fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3c1586-f8f54bf89

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3c1586-f8f54bf89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3c1586: serviceaccount "payload-processing-e2e-api-b-3c1586" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3c1586

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3c1586-67f84785fd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7b5a6c-749c784c95-nf4xb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-40970f-6f5b777875-v49br

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-40970f-65466d45bb-wpvsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-40970f-openshift-default-8558cc99b8-gv9db

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-3c1586

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-3c1586: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-3c1586": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-3c1586, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2ca7e043-83ed-4227-a57a-aa2b25485c6e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-3c1586-f8f54bf89-h44fq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3c1586-67f84785fd-rwtzs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-3c1586-openshift-default-77676bc5f4-j8ckw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d4e72b-659966b86-9v45g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d4e72b-5f7f696b69-cv5zb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-d4e72b-openshift-default-7487dd78f8-7nlvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-75dcf1-6bb79df99f-n8qxz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-75dcf1-6f47dcfbcd-rh6h5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a02b2c-5d57c46b6-hpg55

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a02b2c-ddd696947-m7qp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e8d773

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e8d773

openshift-ingress

deployment-controller

e2e-ipp-a-e8d773-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e8d773-openshift-default-768b4ff9bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb

SuccessfulCreate

Created pod: e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

openshift-ingress

multus

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e8d773-5c68b457cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e8d773

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e8d773-5c68b457cc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e8d773: serviceaccount "payload-processing-e2e-ipp-a-e8d773" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e8d773-5c68b457cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e8d773-5c68b457cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e8d773: serviceaccount "payload-processing-e2e-ipp-a-e8d773" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e8d773

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": read tcp 10.132.0.2:39290->10.132.0.76:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": read tcp 10.132.0.2:39290->10.132.0.76:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-a035eb-openshift-default-f78d94968

SuccessfulCreate

Created pod: e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

openshift-ingress

deployment-controller

e2e-ipp-b-a035eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a035eb-openshift-default-f78d94968 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a035eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a035eb

openshift-ingress

multus

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a035eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a035eb-7997b5d5dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a035eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a035eb: serviceaccount "payload-processing-e2e-ipp-b-a035eb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a035eb: serviceaccount "payload-processing-e2e-ipp-b-a035eb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-4ce51f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4ce51f

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

openshift-ingress

deployment-controller

e2e-ipp-cleanup-4ce51f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f: serviceaccount "payload-processing-e2e-ipp-cleanup-4ce51f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4ce51f: serviceaccount "payload-processing-e2e-ipp-cleanup-4ce51f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-4ce51f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-4ce51f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4ce51f-6f8788479f-qggcp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4ce51f-865b8b57b6-s7x2g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-4ce51f-openshift-default-7894997bc6-v7mrw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e8d773-7bcbc55766-5gxzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e8d773-5c68b457cc-rx76h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a035eb-7997b5d5dc-g4mm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a035eb-76f8c8765d-wqkt7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d25bfb-85c8dcb545-grtmv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d25bfb-7557847d46-p42k5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-d25bfb-openshift-default-d7fb6f454-kj8mh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d634d2-76859ff9f9-f8sxx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d634d2-77f57f86f4-mzc8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x

Killing

Stopping container istio-proxy