Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-mh2b4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-mh2b4 to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm to ip-10-0-139-186.ec2.internal

openshift-ingress

kube-auth-proxy-5b58fb58cc-n4mp7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b58fb58cc-n4mp7 to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45 to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5cbc66-65879468d7-968wb to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8 to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-51815453-59b646665d-66722 to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4 to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8 to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9 to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9 to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf to ip-10-0-141-82.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-8w2cc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8w2cc to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4 to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6 to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-883e85-openshift-default-8446658c86-mkmlq to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn to ip-10-0-139-186.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dwbw9 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96 to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-536a4d-7559ff877f-gcngv to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-51815453-openshift-default-869655f45b-2fcm5 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-699caf96-openshift-default-847c959b56-mfqr7 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm to ip-10-0-139-186.ec2.internal

openshift-ingress

router-default-7bf46bd65d-jtnbl

Scheduled

Successfully assigned openshift-ingress/router-default-7bf46bd65d-jtnbl to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq to ip-10-0-139-186.ec2.internal

openshift-ingress

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76 to ip-10-0-142-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vpmf6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vpmf6 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4 to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl to ip-10-0-141-82.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7 to ip-10-0-141-82.ec2.internal

openshift-ingress

kube-auth-proxy-5b58fb58cc-bdr74

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b58fb58cc-bdr74 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9 to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86 to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4 to ip-10-0-141-82.ec2.internal

openshift-ingress

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf to ip-10-0-141-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs to ip-10-0-139-186.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lnhlh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lnhlh to ip-10-0-141-82.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7bf46bd65d from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-7bf46bd65d

FailedCreate

Error creating: pods "router-default-7bf46bd65d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7bf46bd65d

FailedCreate

Error creating: pods "router-default-7bf46bd65d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7bf46bd65d

SuccessfulCreate

Created pod: router-default-7bf46bd65d-jtnbl
(x5)

openshift-ingress

kubelet

router-default-7bf46bd65d-jtnbl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7bf46bd65d-jtnbl

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7bf46bd65d-jtnbl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-7bf46bd65d-jtnbl

Created

Created container: router

openshift-ingress

kubelet

router-default-7bf46bd65d-jtnbl

Started

Started container router

openshift-ingress

multus

router-default-7bf46bd65d-jtnbl

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5b58fb58cc

SuccessfulCreate

Created pod: kube-auth-proxy-5b58fb58cc-bdr74
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5b58fb58cc

FailedCreate

Error creating: pods "kube-auth-proxy-5b58fb58cc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5b58fb58cc

SuccessfulCreate

Created pod: kube-auth-proxy-5b58fb58cc-n4mp7

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5b58fb58cc from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-bdr74

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5b58fb58cc-bdr74

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-n4mp7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5b58fb58cc-n4mp7

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-8w2cc

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-n4mp7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.446s (2.446s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-n4mp7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-n4mp7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-bdr74

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-8w2cc

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-bdr74

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b58fb58cc-bdr74

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.575s (2.575s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.463s (2.463s including waiting). Image size: 181126104 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rfhrk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.852s (2.852s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vpmf6

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vpmf6

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.64s (2.64s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vpmf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-8w2cc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8w2cc

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-dwbw9

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-mh2b4

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lnhlh

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-mh2b4

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mh2b4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-lnhlh

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lnhlh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lnhlh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lnhlh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mh2b4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mh2b4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lnhlh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.725s (2.725s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mh2b4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.612s (2.612s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

Unhealthy

Startup probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dwbw9

ProbeError

Startup probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-200c07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-200c07-openshift-default-7b76f5dfb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4d5a75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4d5a75

openshift-ingress

deployment-controller

e2e-inf-a-4d5a75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4d5a75-openshift-default-b858f6c66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-4d5a75-openshift-default-b858f6c66

SuccessfulCreate

Created pod: e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-200c07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-200c07

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-047453

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-047453

openshift-ingress

replicaset-controller

e2e-worker-w0-047453-openshift-default-86bddf5b78

SuccessfulCreate

Created pod: e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

openshift-ingress

deployment-controller

e2e-worker-w0-047453-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-047453-openshift-default-86bddf5b78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8

SuccessfulCreate

Created pod: e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

openshift-ingress

multus

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4d5a75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4d5a75-664bc6dbc7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d5a75: serviceaccount "payload-processing-e2e-inf-a-4d5a75" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4d5a75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4d5a75: serviceaccount "payload-processing-e2e-inf-a-4d5a75" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-200c07: serviceaccount "payload-processing-e2e-worker-w4-200c07" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

openshift-ingress

multus

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-200c07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-200c07-647469c66c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-200c07-647469c66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-200c07: serviceaccount "payload-processing-e2e-worker-w4-200c07" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-200c07-647469c66c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-200c07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-200c07-647469c66c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-047453-c4f679d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-047453-c4f679d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-047453-c4f679d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-047453: serviceaccount "payload-processing-e2e-worker-w0-047453" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-047453

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-047453-c4f679d78 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-047453

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-047453-7cd478c9b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-047453-7cd478c9b9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-047453-7cd478c9b9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-047453-7cd478c9b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-047453: serviceaccount "payload-processing-e2e-worker-w0-047453" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-536a4d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-536a4d

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-536a4d-openshift-default-c8cb9c9fb

SuccessfulCreate

Created pod: e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

openshift-ingress

deployment-controller

e2e-autores-536a4d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-536a4d-openshift-default-c8cb9c9fb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-ait-d6df0e9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d6df0e9a

openshift-ingress

multus

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d6df0e9a-openshift-default-b8948f754

SuccessfulCreate

Created pod: e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

openshift-ingress

deployment-controller

e2e-ait-d6df0e9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d6df0e9a-openshift-default-b8948f754 from 0 to 1

openshift-ingress

multus

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.726s (2.726s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d6df0e9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d6df0e9a-5dcf57f68f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d6df0e9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

openshift-ingress

multus

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6df0e9a: serviceaccount "payload-processing-e2e-ait-d6df0e9a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6df0e9a: serviceaccount "payload-processing-e2e-ait-d6df0e9a" not found

openshift-ingress

multus

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-536a4d-7559ff877f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-536a4d-7559ff877f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-536a4d: serviceaccount "payload-processing-e2e-autores-536a4d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e8f201

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e8f201

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-536a4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-536a4d-f6cbd59d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-536a4d: serviceaccount "payload-processing-e2e-autores-536a4d" not found

openshift-ingress

deployment-controller

e2e-inf-b-e8f201-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e8f201-openshift-default-7fc967d568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-e8f201-openshift-default-7fc967d568

SuccessfulCreate

Created pod: e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-536a4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-536a4d-7559ff877f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-536a4d-7559ff877f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

openshift-ingress

multus

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

Started

Started container payload-processing

openshift-ingress

multus

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e8f201

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e8f201-79866b68c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e8f201: serviceaccount "payload-processing-e2e-inf-b-e8f201" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e8f201-79866b68c5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e8f201-79866b68c5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e8f201-79866b68c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e8f201: serviceaccount "payload-processing-e2e-inf-b-e8f201" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e8f201

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e8f201-6798855ccd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x7)

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-d6df0e9a-5dcf57f68f-ckfmw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-d6df0e9a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-d6df0e9a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-d6df0e9a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-d6df0e9a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 198bd48c-26fa-4ef0-90b9-0d89c5a4ea1d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6df0e9a-698bfc48cd-98x45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-414d08da-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-414d08da-gw-openshift-default-69b446cb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-414d08da-gw-openshift-default-69b446cb8

SuccessfulCreate

Created pod: e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

openshift-ingress

gateway_labeler_controller

e2e-migrate-414d08da-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-414d08da-gw

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-d6df0e9a-openshift-default-b8948f754-czzgb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-414d08da-5899869ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-414d08da-86888b4954

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-414d08da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-414d08da-86888b4954 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-414d08da-86888b4954

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-414d08da-86888b4954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-414d08da: serviceaccount "payload-processing-e2e-migrate-414d08da" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-414d08da-5899869ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-414d08da-5899869ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-414d08da: serviceaccount "payload-processing-e2e-migrate-414d08da" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-414d08da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-414d08da-5899869ddb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-414d08da-5899869ddb-lq79f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-414d08da-86888b4954-2jpw4

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-f8e161a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f8e161a6

openshift-ingress

replicaset-controller

e2e-ait-f8e161a6-openshift-default-7b6b9745d4

SuccessfulCreate

Created pod: e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

openshift-ingress

kubelet

e2e-migrate-414d08da-gw-openshift-default-69b446cb8-86lpv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-f8e161a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f8e161a6-openshift-default-7b6b9745d4 from 0 to 1

openshift-ingress

multus

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8e161a6: serviceaccount "payload-processing-e2e-ait-f8e161a6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8e161a6-779c7fccff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f8e161a6-779c7fccff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8e161a6: serviceaccount "payload-processing-e2e-ait-f8e161a6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8e161a6-779c7fccff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f8e161a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f8e161a6-779c7fccff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f8e161a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f8e161a6-75876b77c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

openshift-ingress

multus

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-f8e161a6-779c7fccff-4z5hv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8e161a6-75876b77c8-tdzdm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f8e161a6-openshift-default-7b6b9745d4-5ntwt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0b2b4b09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0b2b4b09

openshift-ingress

deployment-controller

e2e-derive-0b2b4b09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0b2b4b09-openshift-default-694d65944 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-0b2b4b09-openshift-default-694d65944

SuccessfulCreate

Created pod: e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

openshift-ingress

multus

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0b2b4b09: serviceaccount "payload-processing-e2e-derive-0b2b4b09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0b2b4b09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0b2b4b09-6d7b97fc69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0b2b4b09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0b2b4b09-67456446cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0b2b4b09: serviceaccount "payload-processing-e2e-derive-0b2b4b09" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

openshift-ingress

multus

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-0b2b4b09-openshift-default-694d65944-4szjm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0b2b4b09-67456446cd-wpltf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0b2b4b09-6d7b97fc69-h825h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-536a4d-f6cbd59d6-gsqsl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-536a4d-7559ff877f-gcngv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-536a4d-openshift-default-c8cb9c9fb-kwld4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-a228c4-openshift-default-67f4b4d7d4

SuccessfulCreate

Created pod: e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

openshift-ingress

deployment-controller

e2e-explicit-a228c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a228c4-openshift-default-67f4b4d7d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-a228c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a228c4

openshift-ingress

multus

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a228c4-7686c9dbd9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a228c4-7686c9dbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a228c4: serviceaccount "payload-processing-e2e-explicit-a228c4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a228c4: serviceaccount "payload-processing-e2e-explicit-a228c4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a228c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a228c4-7686c9dbd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a228c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a228c4-7686c9dbd9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-51815453-openshift-default-869655f45b

SuccessfulCreate

Created pod: e2e-mt-51815453-openshift-default-869655f45b-2fcm5

openshift-ingress

deployment-controller

e2e-mt-51815453-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-51815453-openshift-default-869655f45b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-51815453

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-51815453

openshift-ingress

multus

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-51815453

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-51815453-b54cb7dfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51815453-b54cb7dfc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

openshift-ingress

multus

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51815453-b54cb7dfc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-51815453-b54cb7dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51815453: serviceaccount "payload-processing-e2e-mt-51815453" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51815453-59b646665d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-51815453-59b646665d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51815453: serviceaccount "payload-processing-e2e-mt-51815453" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51815453-59b646665d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-51815453-59b646665d-66722

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-51815453

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-51815453-59b646665d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51815453-59b646665d-66722

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51815453-b54cb7dfc-dqpfm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-51815453

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-51815453: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-51815453": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-51815453, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1e1778d7-22a0-480c-8e15-6d2d0b8df865, UID in object meta:

openshift-ingress

kubelet

e2e-mt-51815453-openshift-default-869655f45b-2fcm5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb

SuccessfulCreate

Created pod: e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-72c98d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-72c98d

openshift-ingress

deployment-controller

e2e-shared-a-w2-72c98d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72c98d: serviceaccount "payload-processing-e2e-shared-a-w2-72c98d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72c98d: serviceaccount "payload-processing-e2e-shared-a-w2-72c98d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-72c98d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-72c98d-645974d6cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-72c98d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a228c4-6fb6d4bf94-snpdj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a228c4-7686c9dbd9-h8dfc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-a228c4-openshift-default-67f4b4d7d4-x22qn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-3b7488-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3b7488-openshift-default-5dcd49db56 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w2-238bae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-238bae-openshift-default-7c894fdff8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-238bae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-238bae

openshift-ingress

gateway_labeler_controller

e2e-noten-3b7488

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3b7488

openshift-ingress

replicaset-controller

e2e-noten-3b7488-openshift-default-5dcd49db56

SuccessfulCreate

Created pod: e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

openshift-ingress

replicaset-controller

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8

SuccessfulCreate

Created pod: e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

openshift-ingress

multus

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-238bae-58db4b64df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-238bae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-238bae: serviceaccount "payload-processing-e2e-shared-b-w2-238bae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-238bae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-238bae-58db4b64df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-238bae-58db4b64df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-238bae-58db4b64df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-238bae: serviceaccount "payload-processing-e2e-shared-b-w2-238bae" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-699caf96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-699caf96-openshift-default-847c959b56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-699caf96-openshift-default-847c959b56

SuccessfulCreate

Created pod: e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

openshift-ingress

gateway_labeler_controller

e2e-mt-699caf96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-699caf96
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-699caf96-865b55fc45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-699caf96-865b55fc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-699caf96: serviceaccount "payload-processing-e2e-mt-699caf96" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-699caf96: serviceaccount "payload-processing-e2e-mt-699caf96" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-699caf96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-699caf96-865b55fc45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-699caf96-865b55fc45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-699caf96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-699caf96-fd74cc7bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4d5a75-664bc6dbc7-tcbnp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4d5a75-697bfbb486-pf9rq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-4d5a75-openshift-default-b858f6c66-rn7kp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8f201-6798855ccd-4lpln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8f201-79866b68c5-fq9v4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-3b7488-openshift-default-5dcd49db56-m27w7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e8f201-openshift-default-7fc967d568-shbl4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d90e71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d90e71

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96

SuccessfulCreate

Created pod: e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

openshift-ingress

deployment-controller

e2e-shared-a-w3-d90e71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d90e71-openshift-default-77994bbb96 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d90e71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d90e71: serviceaccount "payload-processing-e2e-shared-a-w3-d90e71" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d90e71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d90e71-64c7958767 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d90e71-64c7958767

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d90e71-64c7958767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d90e71: serviceaccount "payload-processing-e2e-shared-a-w3-d90e71" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d90e71-64c7958767

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-047453-c4f679d78-c78j9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-047453-7cd478c9b9-74675

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-047453-openshift-default-86bddf5b78-mmnn8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-553671

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-553671

openshift-ingress

deployment-controller

e2e-shared-b-w3-553671-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-553671-openshift-default-84cbc99bdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd

SuccessfulCreate

Created pod: e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

openshift-ingress

multus

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-553671

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-553671-685fb49587

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-553671-685fb49587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-553671: serviceaccount "payload-processing-e2e-shared-b-w3-553671" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-553671: serviceaccount "payload-processing-e2e-shared-b-w3-553671" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-553671

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-553671-685fb49587 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-553671-685fb49587

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-699caf96-865b55fc45-2fzlm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-699caf96-fd74cc7bb-8pvt8

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-699caf96

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-699caf96: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-699caf96": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-699caf96, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7000650c-b755-4f73-8556-338a1078972f, UID in object meta:

openshift-ingress

kubelet

e2e-mt-699caf96-openshift-default-847c959b56-mfqr7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-883e85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-883e85

openshift-ingress

deployment-controller

e2e-api-a-883e85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-883e85-openshift-default-8446658c86 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-883e85-openshift-default-8446658c86

SuccessfulCreate

Created pod: e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

openshift-ingress

multus

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-883e85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-883e85-594b9cb4c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-883e85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-883e85-67df75b6b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-883e85: serviceaccount "payload-processing-e2e-api-a-883e85" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-883e85-67df75b6b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-883e85-67df75b6b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-883e85-67df75b6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-883e85: serviceaccount "payload-processing-e2e-api-a-883e85" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-5cbc66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5cbc66

openshift-ingress

deployment-controller

e2e-api-b-5cbc66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5cbc66-openshift-default-8cb77c7f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-5cbc66-openshift-default-8cb77c7f6

SuccessfulCreate

Created pod: e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k
(x5)

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5cbc66-65879468d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5cbc66-65879468d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5cbc66: serviceaccount "payload-processing-e2e-api-b-5cbc66" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5cbc66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5cbc66: serviceaccount "payload-processing-e2e-api-b-5cbc66" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5cbc66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5cbc66-65879468d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5cbc66-65879468d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-883e85

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-883e85: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-883e85": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-883e85, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e754ed05-e877-4f51-9fd6-60ee6df38320, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-883e85-594b9cb4c8-fq4pm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-883e85-67df75b6b9-bgrh9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-883e85-openshift-default-8446658c86-mkmlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5cbc66-5cdc4cbdc8-wvfwz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5cbc66-65879468d7-968wb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-5cbc66-openshift-default-8cb77c7f6-7hc6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-200c07-6f7c7856cd-sdzql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72c98d-58968587d-pqplb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72c98d-645974d6cf-5s7rf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-200c07-647469c66c-dvcfq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-200c07-openshift-default-7b76f5dfb8-vd6nl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-72c98d-openshift-default-5d78fd89fb-g8v2q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-238bae-58db4b64df-tj786

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-238bae-b7ff5df54-pbczn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-238bae-openshift-default-7c894fdff8-nqz76

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-da4d13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-da4d13-openshift-default-78885dfd96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-da4d13-openshift-default-78885dfd96

SuccessfulCreate

Created pod: e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-da4d13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-da4d13

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-da4d13-56fd97c675

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-da4d13-56fd97c675

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-da4d13-56fd97c675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-da4d13: serviceaccount "payload-processing-e2e-ipp-a-da4d13" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-da4d13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-da4d13-558b545d98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

openshift-ingress

multus

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-da4d13: serviceaccount "payload-processing-e2e-ipp-a-da4d13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-da4d13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-da4d13-56fd97c675 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696

SuccessfulCreate

Created pod: e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0ed2c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0ed2c8

openshift-ingress

deployment-controller

e2e-ipp-b-0ed2c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0ed2c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ed2c8: serviceaccount "payload-processing-e2e-ipp-b-0ed2c8" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ed2c8: serviceaccount "payload-processing-e2e-ipp-b-0ed2c8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0ed2c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-1cb71b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-1cb71b

openshift-ingress

deployment-controller

e2e-ipp-cleanup-1cb71b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

openshift-ingress

multus

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1cb71b: serviceaccount "payload-processing-e2e-ipp-cleanup-1cb71b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1cb71b: serviceaccount "payload-processing-e2e-ipp-cleanup-1cb71b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-1cb71b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-1cb71b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1cb71b-77cd48c4ff-2wv86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1cb71b-7895b884c8-8kh2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-1cb71b-openshift-default-5d577868dd-j9z96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-da4d13-56fd97c675-2fdgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-da4d13-558b545d98-hkvjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-da4d13-openshift-default-78885dfd96-hhjpm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ed2c8-6785c84846-jd7hs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ed2c8-55485dc4f5-mr7v9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-0ed2c8-openshift-default-6fcff4b696-wlfsv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d90e71-75cf48b6b6-s4nj4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d90e71-64c7958767-p9dg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-d90e71-openshift-default-77994bbb96-9wf2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-553671-685fb49587-6srz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-553671-6989bb446b-bn42d

Unhealthy

Readiness probe failed: dial tcp 10.133.0.62:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-553671-openshift-default-84cbc99bdd-wkjpq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: