Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6 to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Scheduled

Successfully assigned openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk to ip-10-0-138-7.ec2.internal

openshift-ingress

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2 to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6 to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-sf4lg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-sf4lg to ip-10-0-129-67.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-z8dj5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5 to ip-10-0-138-7.ec2.internal

openshift-ingress

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Scheduled

Successfully assigned openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-9e9409-5d657977f7-btvn7 to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6 to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl to ip-10-0-138-7.ec2.internal

openshift-ingress

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r to ip-10-0-138-7.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2h86h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2h86h to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7 to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx to ip-10-0-138-7.ec2.internal

openshift-ingress

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5 to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8 to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv to ip-10-0-129-67.ec2.internal

openshift-ingress

kube-auth-proxy-f7577f47d-jfkrw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-f7577f47d-jfkrw to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4 to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-hzhpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-hzhpk to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw to ip-10-0-129-67.ec2.internal

openshift-ingress

router-default-8498d4ff98-642dx

Scheduled

Successfully assigned openshift-ingress/router-default-8498d4ff98-642dx to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz to ip-10-0-138-7.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr to ip-10-0-129-67.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vnqfd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vnqfd to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp to ip-10-0-129-67.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf to ip-10-0-129-67.ec2.internal

openshift-ingress

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn to ip-10-0-129-67.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd to ip-10-0-129-67.ec2.internal

openshift-ingress

kube-auth-proxy-f7577f47d-r96lt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-f7577f47d-r96lt to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr to ip-10-0-131-170.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx to ip-10-0-131-170.ec2.internal

openshift-ingress

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4 to ip-10-0-138-7.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8498d4ff98 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-8498d4ff98

FailedCreate

Error creating: pods "router-default-8498d4ff98-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-8498d4ff98

FailedCreate

Error creating: pods "router-default-8498d4ff98-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8498d4ff98

SuccessfulCreate

Created pod: router-default-8498d4ff98-642dx
(x6)

openshift-ingress

kubelet

router-default-8498d4ff98-642dx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-8498d4ff98-642dx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-8498d4ff98-642dx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-8498d4ff98-642dx

Started

Started container router

openshift-ingress

multus

router-default-8498d4ff98-642dx

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8498d4ff98-642dx

Created

Created container: router
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-f7577f47d

FailedCreate

Error creating: pods "kube-auth-proxy-f7577f47d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-f7577f47d from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-f7577f47d

SuccessfulCreate

Created pod: kube-auth-proxy-f7577f47d-r96lt

openshift-ingress

replicaset-controller

kube-auth-proxy-f7577f47d

SuccessfulCreate

Created pod: kube-auth-proxy-f7577f47d-jfkrw

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-r96lt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-jfkrw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-f7577f47d-jfkrw

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-f7577f47d-r96lt

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vnqfd

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vnqfd

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-jfkrw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-jfkrw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.836s (2.836s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-jfkrw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-r96lt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.031s (4.031s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-r96lt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-f7577f47d-r96lt

Created

Created container: kube-auth-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-z8dj5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z8dj5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-z8dj5

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Started

Started container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 14.107s (14.107s including waiting). Image size: 181126104 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z8dj5

Created

Created container: discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z8dj5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z8dj5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.264s (2.264s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vnqfd

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vnqfd

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.095s (4.095s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c8jfj

Created

Created container: istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2h86h

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2h86h

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-sf4lg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-hzhpk

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-sf4lg

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-sf4lg

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hzhpk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-hzhpk

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hzhpk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hzhpk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hzhpk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.679s (1.679s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-sf4lg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.364s (3.364s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-sf4lg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-sf4lg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2h86h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2h86h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2h86h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2h86h

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2h86h

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6a6c05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6a6c05

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-dbe8a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-dbe8a7

openshift-ingress

replicaset-controller

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b

SuccessfulCreate

Created pod: e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f996ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f996ae

openshift-ingress

GatewayAuthBootstrap

e2e-worker-w4-dbe8a7

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-worker-w4-dbe8a7-authn-ssl: envoyfilters.networking.istio.io "e2e-worker-w4-dbe8a7-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-worker-w0-f996ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f996ae-openshift-default-8bcc8c97b from 0 to 1

openshift-ingress

multus

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658

SuccessfulCreate

Created pod: e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-inf-a-6a6c05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6a6c05-openshift-default-58c744bcb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-6a6c05-openshift-default-58c744bcb8

SuccessfulCreate

Created pod: e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

openshift-ingress

multus

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-dbe8a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-dbe8a7-openshift-default-7c694f9658 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.65s (2.65s including waiting). Image size: 181318953 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f996ae-6ff6f44479

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f996ae-6ff6f44479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f996ae: serviceaccount "payload-processing-e2e-worker-w0-f996ae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f996ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f996ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f996ae-6ff6f44479 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f996ae: serviceaccount "payload-processing-e2e-worker-w0-f996ae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f996ae-6ff6f44479

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

openshift-ingress

multus

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-9e9409-openshift-default-57657b7b78

SuccessfulCreate

Created pod: e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

openshift-ingress

deployment-controller

e2e-autores-9e9409-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-9e9409-openshift-default-57657b7b78 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-9e9409

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-9e9409

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6a6c05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6a6c05-65f65cd7d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6a6c05: serviceaccount "payload-processing-e2e-inf-a-6a6c05" not found

openshift-ingress

multus

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6a6c05: serviceaccount "payload-processing-e2e-inf-a-6a6c05" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6a6c05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-dbe8a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-dbe8a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-dbe8a7-777b494f85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-dbe8a7: serviceaccount "payload-processing-e2e-worker-w4-dbe8a7" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-dbe8a7-777b494f85

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-dbe8a7-777b494f85

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-dbe8a7-777b494f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-dbe8a7: serviceaccount "payload-processing-e2e-worker-w4-dbe8a7" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-4b89cb58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4b89cb58

openshift-ingress

replicaset-controller

e2e-ait-4b89cb58-openshift-default-b4885c7db

SuccessfulCreate

Created pod: e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

openshift-ingress

multus

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-4b89cb58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4b89cb58-openshift-default-b4885c7db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-9e9409

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-9e9409-5d657977f7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e9409-5d657977f7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-9e9409-5d657977f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e9409: serviceaccount "payload-processing-e2e-autores-9e9409" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e9409-cfcfff89d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-9e9409-cfcfff89d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e9409: serviceaccount "payload-processing-e2e-autores-9e9409" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e9409-cfcfff89d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-9e9409

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-9e9409-cfcfff89d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e9409-5d657977f7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

openshift-ingress

deployment-controller

e2e-inf-b-3d5c73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3d5c73-openshift-default-869765f49d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3d5c73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3d5c73
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-3d5c73-openshift-default-869765f49d

SuccessfulCreate

Created pod: e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4b89cb58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4b89cb58-579d5787bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4b89cb58: serviceaccount "payload-processing-e2e-ait-4b89cb58" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4b89cb58-579d5787bf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4b89cb58-579d5787bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4b89cb58: serviceaccount "payload-processing-e2e-ait-4b89cb58" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4b89cb58-579d5787bf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4b89cb58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4b89cb58-6684484d7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

openshift-ingress

kubelet

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3d5c73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3d5c73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3d5c73-669bb597d9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3d5c73-669bb597d9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3d5c73-669bb597d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3d5c73: serviceaccount "payload-processing-e2e-inf-b-3d5c73" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3d5c73: serviceaccount "payload-processing-e2e-inf-b-3d5c73" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3d5c73-669bb597d9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:40588->10.132.0.48:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:40588->10.132.0.48:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-4b89cb58-579d5787bf-z6qgk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4b89cb58-6684484d7d-zvtj4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688

SuccessfulCreate

Created pod: e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

openshift-ingress

deployment-controller

e2e-migrate-a0a97fdf-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-a0a97fdf-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a0a97fdf-gw

openshift-ingress

multus

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0a97fdf: serviceaccount "payload-processing-e2e-migrate-a0a97fdf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a0a97fdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a0a97fdf-544d64f5b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0a97fdf: serviceaccount "payload-processing-e2e-migrate-a0a97fdf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a0a97fdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0a97fdf-85547b76f8-tbwsr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0a97fdf-544d64f5b6-pqcjt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-a9151699-openshift-default-5ddc78cf9d

SuccessfulCreate

Created pod: e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

openshift-ingress

deployment-controller

e2e-ait-a9151699-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a9151699-openshift-default-5ddc78cf9d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a9151699

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a9151699

openshift-ingress

multus

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9151699-9c5d89f97

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a9151699-9c5d89f97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9151699: serviceaccount "payload-processing-e2e-ait-a9151699" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9151699-9c5d89f97

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a9151699

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a9151699-9c5d89f97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a9151699

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9151699: serviceaccount "payload-processing-e2e-ait-a9151699" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e9409-cfcfff89d-q6srr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e9409-5d657977f7-btvn7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9151699-6d5bdd5dc4-hswww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9151699-9c5d89f97-52fh6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-a9151699

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-a9151699: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-a9151699": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-a9151699, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4f067670-92fa-493f-956c-ed6b89171f67, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-derive-c85107f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c85107f9

openshift-ingress

deployment-controller

e2e-derive-c85107f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c85107f9-openshift-default-c66465fb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-c85107f9-openshift-default-c66465fb4

SuccessfulCreate

Created pod: e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-4bd0ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4bd0ef

openshift-ingress

deployment-controller

e2e-explicit-4bd0ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8

SuccessfulCreate

Created pod: e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-9e9409-openshift-default-57657b7b78-8hmvp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c85107f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c85107f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c85107f9-66994bfdf7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c85107f9: serviceaccount "payload-processing-e2e-derive-c85107f9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c85107f9-66994bfdf7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c85107f9-66994bfdf7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c85107f9-66994bfdf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c85107f9: serviceaccount "payload-processing-e2e-derive-c85107f9" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4bd0ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4bd0ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4bd0ef-5db6d44945 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

openshift-ingress

kubelet

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4bd0ef-5db6d44945

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4bd0ef-5db6d44945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4bd0ef: serviceaccount "payload-processing-e2e-explicit-4bd0ef" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4bd0ef-5db6d44945

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4bd0ef: serviceaccount "payload-processing-e2e-explicit-4bd0ef" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c85107f9-6c77dd8f66-6qt8k

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-c85107f9-66994bfdf7-8hsl6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-93af11bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-93af11bc

openshift-ingress

deployment-controller

e2e-mt-93af11bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-93af11bc-openshift-default-5cdf9d889b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-93af11bc-openshift-default-5cdf9d889b

SuccessfulCreate

Created pod: e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

openshift-ingress

multus

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-4bd0ef-5db6d44945-cb9wf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4bd0ef-769b59c79d-nhdmj

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-93af11bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-93af11bc-588fddb4d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-93af11bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-93af11bc: serviceaccount "payload-processing-e2e-mt-93af11bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-93af11bc-588fddb4d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-93af11bc-588fddb4d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-93af11bc-588fddb4d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-93af11bc: serviceaccount "payload-processing-e2e-mt-93af11bc" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-2d1bcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-2d1bcf-openshift-default-797687f5b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-2d1bcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-2d1bcf

openshift-ingress

replicaset-controller

e2e-noten-2d1bcf-openshift-default-797687f5b8

SuccessfulCreate

Created pod: e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-93af11bc-588fddb4d9-jv2h2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-93af11bc-6699cf7c9d-sbjnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66

SuccessfulCreate

Created pod: e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

openshift-ingress

multus

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-a23afc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a23afc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a23afc

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a23afc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a23afc-b6b947f69 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a23afc: serviceaccount "payload-processing-e2e-shared-a-w2-a23afc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a23afc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a23afc: serviceaccount "payload-processing-e2e-shared-a-w2-a23afc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-12d586

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-12d586

openshift-ingress

deployment-controller

e2e-shared-b-w2-12d586-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-12d586-openshift-default-d5b77854d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-12d586-openshift-default-d5b77854d

SuccessfulCreate

Created pod: e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

openshift-ingress

multus

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-12d586-547cd9789f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-12d586-547cd9789f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-12d586: serviceaccount "payload-processing-e2e-shared-b-w2-12d586" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-12d586-547cd9789f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-12d586

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-12d586-547cd9789f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-12d586: serviceaccount "payload-processing-e2e-shared-b-w2-12d586" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-12d586

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6a6c05-5f99497d46-24d6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6a6c05-65f65cd7d7-xhhwf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d

SuccessfulCreate

Created pod: e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

openshift-ingress

deployment-controller

e2e-mt-d8ea1ea7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d8ea1ea7-openshift-default-7894f9d68d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-d8ea1ea7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d8ea1ea7

openshift-ingress

kubelet

e2e-inf-a-6a6c05-openshift-default-58c744bcb8-44jbv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d8ea1ea7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d8ea1ea7-64fccdc845 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8ea1ea7-64fccdc845

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d8ea1ea7-64fccdc845

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d8ea1ea7-64fccdc845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8ea1ea7: serviceaccount "payload-processing-e2e-mt-d8ea1ea7" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d8ea1ea7: serviceaccount "payload-processing-e2e-mt-d8ea1ea7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d8ea1ea7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3d5c73-5fcc759cdb-hwnj7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3d5c73-669bb597d9-7l6lf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8f8dad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8f8dad

openshift-ingress

deployment-controller

e2e-shared-a-w3-8f8dad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8

SuccessfulCreate

Created pod: e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

openshift-ingress

multus

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8f8dad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8f8dad: serviceaccount "payload-processing-e2e-shared-a-w3-8f8dad" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8f8dad: serviceaccount "payload-processing-e2e-shared-a-w3-8f8dad" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8f8dad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-35b181-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-35b181-openshift-default-d545877f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-35b181-openshift-default-d545877f4

SuccessfulCreate

Created pod: e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-35b181

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-35b181

openshift-ingress

multus

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-35b181

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-35b181-777c5f9b69 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-35b181

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-35b181: serviceaccount "payload-processing-e2e-shared-b-w3-35b181" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-35b181: serviceaccount "payload-processing-e2e-shared-b-w3-35b181" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-d8ea1ea7-64fccdc845-fwzlr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d8ea1ea7-7fb4fb44fd-kxxfw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-d8ea1ea7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-d8ea1ea7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-d8ea1ea7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-d8ea1ea7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8f95acbc-a00e-452d-aaab-1b7d1c49d3f2, UID in object meta:

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-194000-openshift-default-75f76ccbf6

SuccessfulCreate

Created pod: e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

openshift-ingress

deployment-controller

e2e-api-a-194000-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-194000-openshift-default-75f76ccbf6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-194000

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-194000

openshift-ingress

multus

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-194000

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-194000-6b89896cd6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-194000

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-194000-7d7c6b9595 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-194000-7d7c6b9595

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-194000-7d7c6b9595

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-194000-7d7c6b9595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-194000: serviceaccount "payload-processing-e2e-api-a-194000" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-194000-6b89896cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-194000-6b89896cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-194000-6b89896cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-194000: serviceaccount "payload-processing-e2e-api-a-194000" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-7dd893

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7dd893
(x2)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Started

Started container istio-proxy

openshift-ingress

multus

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-7dd893-openshift-default-75d44b4bcb

SuccessfulCreate

Created pod: e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

openshift-ingress

deployment-controller

e2e-api-b-7dd893-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7dd893-openshift-default-75d44b4bcb from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7dd893

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7dd893-5fff5d7c7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7dd893-5fff5d7c7f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7dd893-5fff5d7c7f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7dd893-5fff5d7c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7dd893: serviceaccount "payload-processing-e2e-api-b-7dd893" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7dd893

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7dd893: serviceaccount "payload-processing-e2e-api-b-7dd893" not found

openshift-ingress

multus

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f996ae-6ff6f44479-wh7kt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f996ae-65ffc957cd-xkl7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-194000-7d7c6b9595-n8rzv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-194000-6b89896cd6-nbg9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-f996ae-openshift-default-8bcc8c97b-p9njz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7dd893-6ffc85b4c8-pxsgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7dd893-5fff5d7c7f-nzkbg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-7dd893-openshift-default-dockercfg-7rp7k); attempting to pull the image may not succeed.
(x2)

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-a23afc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a23afc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-a23afc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a23afc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 96eab8cb-74a6-496a-95d9-6ddfa0439c41, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a23afc-b6b947f69-l2mr6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a23afc-5c9c6b64f4-mz6zz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-12d586-547cd9789f-smxzg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-12d586-5446dd85b6-mm2t8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-dbe8a7-58ff4c79f8-zfxf5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-dbe8a7-777b494f85-d5f9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a71836

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a71836

openshift-ingress

deployment-controller

e2e-ipp-a-a71836-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a71836-openshift-default-d6cd546f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-a71836-openshift-default-d6cd546f4

SuccessfulCreate

Created pod: e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

openshift-ingress

multus

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a71836

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a71836-f785687fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a71836-7f85579b5c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a71836-7f85579b5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a71836: serviceaccount "payload-processing-e2e-ipp-a-a71836" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a71836

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a71836-7f85579b5c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a71836-f785687fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a71836-f785687fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a71836: serviceaccount "payload-processing-e2e-ipp-a-a71836" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a71836-f785687fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a71836-7f85579b5c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-813cee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-813cee

openshift-ingress

replicaset-controller

e2e-ipp-b-813cee-openshift-default-777c895b74

SuccessfulCreate

Created pod: e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

openshift-ingress

deployment-controller

e2e-ipp-b-813cee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-813cee-openshift-default-777c895b74 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-813cee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-813cee: serviceaccount "payload-processing-e2e-ipp-b-813cee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-813cee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-813cee: serviceaccount "payload-processing-e2e-ipp-b-813cee" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2e0396

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2e0396

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2e0396-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

openshift-ingress

multus

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2e0396: serviceaccount "payload-processing-e2e-ipp-cleanup-2e0396" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2e0396

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2e0396-588c844685

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2e0396-588c844685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2e0396: serviceaccount "payload-processing-e2e-ipp-cleanup-2e0396" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2e0396-588c844685

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2e0396

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2e0396-588c844685 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e0396-588c844685-rlxxr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-2e0396

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e0396: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-2e0396": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e0396, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f6cf3438-7e05-4acb-aee8-1408a65b7e1d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e0396-7499b5c5c4-m4s8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a71836-f785687fd-s6qvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a71836-7f85579b5c-2k2sk

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-ipp-a-a71836" not found

openshift-ingress

kubelet

e2e-ipp-a-a71836-openshift-default-d6cd546f4-982fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-813cee-6fd6bb5cb5-9pgpp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-813cee-d56db7ffd-cjc6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-813cee-openshift-default-777c895b74-rjjwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f8dad-85dbf497bb-tvvcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f8dad-54dd945d77-n2r2w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-8f8dad-openshift-default-55b6f478f8-r5hzs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-35b181-777c5f9b69-jc62h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-35b181-769fc5d698-928hk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503