Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86 to ip-10-0-128-50.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8mpb to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h to ip-10-0-128-50.ec2.internal

openshift-ingress

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm to ip-10-0-128-50.ec2.internal

openshift-ingress

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g to ip-10-0-132-217.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5 to ip-10-0-128-50.ec2.internal

openshift-ingress

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6 to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4 to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4 to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2 to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6 to ip-10-0-132-137.ec2.internal

openshift-ingress

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7 to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-g9lgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-g9lgv to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf to ip-10-0-132-137.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-t8c7r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-t8c7r to ip-10-0-132-137.ec2.internal

openshift-ingress

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6 to ip-10-0-132-137.ec2.internal

openshift-ingress

kube-auth-proxy-75f575964-h6spt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75f575964-h6spt to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4 to ip-10-0-128-50.ec2.internal

openshift-ingress

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Scheduled

Successfully assigned openshift-ingress/e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k to ip-10-0-128-50.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hx9c8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hx9c8 to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9 to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4 to ip-10-0-132-137.ec2.internal

openshift-ingress

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj to ip-10-0-132-137.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cj4jw to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5 to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5317692d-5f79588665-rdztg to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt to ip-10-0-128-50.ec2.internal

openshift-ingress

router-default-6f487956db-zccck

Scheduled

Successfully assigned openshift-ingress/router-default-6f487956db-zccck to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl to ip-10-0-132-217.ec2.internal

openshift-ingress

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942 to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-84fdff-bf594d749-qtxbk to ip-10-0-132-217.ec2.internal

openshift-ingress

kube-auth-proxy-75f575964-l8ggl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-75f575964-l8ggl to ip-10-0-132-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6 to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw to ip-10-0-132-137.ec2.internal

openshift-ingress

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t to ip-10-0-132-137.ec2.internal

openshift-ingress

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq to ip-10-0-128-50.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-x4c4q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-x4c4q to ip-10-0-132-217.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6 to ip-10-0-128-50.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6f487956db from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-6f487956db

FailedCreate

Error creating: pods "router-default-6f487956db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6f487956db

FailedCreate

Error creating: pods "router-default-6f487956db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6f487956db

SuccessfulCreate

Created pod: router-default-6f487956db-zccck
(x5)

openshift-ingress

kubelet

router-default-6f487956db-zccck

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-6f487956db-zccck

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6f487956db-zccck

Started

Started container router

openshift-ingress

kubelet

router-default-6f487956db-zccck

Created

Created container: router

openshift-ingress

kubelet

router-default-6f487956db-zccck

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6f487956db-zccck

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-75f575964

SuccessfulCreate

Created pod: kube-auth-proxy-75f575964-l8ggl

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-75f575964 from 0 to 2
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-75f575964

FailedCreate

Error creating: pods "kube-auth-proxy-75f575964-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-75f575964

SuccessfulCreate

Created pod: kube-auth-proxy-75f575964-h6spt

openshift-ingress

multus

kube-auth-proxy-75f575964-l8ggl

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-75f575964-l8ggl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-75f575964-h6spt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-75f575964-h6spt

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hx9c8

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hx9c8

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-75f575964-h6spt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.901s (2.901s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-75f575964-h6spt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75f575964-h6spt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75f575964-l8ggl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-75f575964-l8ggl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.561s (3.561s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-75f575964-l8ggl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.858s (3.858s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.434s (5.434s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-t8c7r

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t8c7r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 9.52s (9.52s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5c2x5

Started

Started container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-t8c7r

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bct8mpb
(x6)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8mpb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t8c7r

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t8c7r

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t8c7r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.078s (2.078s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hx9c8

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hx9c8
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-cj4jw

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-g9lgv
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-x4c4q

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-x4c4q

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x4c4q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g9lgv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-g9lgv

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x4c4q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.264s (1.265s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x4c4q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x4c4q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g9lgv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g9lgv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.475s (2.475s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g9lgv

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cj4jw

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-5d484d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-5d484d

openshift-ingress

deployment-controller

e2e-worker-w4-5d484d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-5d484d-openshift-default-8b7b595d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-5d484d-openshift-default-8b7b595d

SuccessfulCreate

Created pod: e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

openshift-ingress

gateway_labeler_controller

e2e-inf-a-094dab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-094dab

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-924916

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-924916

openshift-ingress

deployment-controller

e2e-worker-w0-924916-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-924916-openshift-default-5c494577bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-924916-openshift-default-5c494577bb

SuccessfulCreate

Created pod: e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

openshift-ingress

deployment-controller

e2e-inf-a-094dab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-094dab-openshift-default-7d86774f74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-094dab-openshift-default-7d86774f74

SuccessfulCreate

Created pod: e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

openshift-ingress

multus

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-094dab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-094dab-95bc57677 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-094dab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-094dab-6c6d699fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-094dab: serviceaccount "payload-processing-e2e-inf-a-094dab" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-094dab-95bc57677

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-094dab-95bc57677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-094dab: serviceaccount "payload-processing-e2e-inf-a-094dab" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-094dab-95bc57677

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

openshift-ingress

multus

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-5d484d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-5d484d-d76945b69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-5d484d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-5d484d: serviceaccount "payload-processing-e2e-worker-w4-5d484d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-5d484d-d76945b69

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-5d484d-d76945b69

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-5d484d-d76945b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-5d484d: serviceaccount "payload-processing-e2e-worker-w4-5d484d" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-84fdff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-84fdff

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-924916-75cdc8867c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-924916

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-924916-75cdc8867c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-924916

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-924916: serviceaccount "payload-processing-e2e-worker-w0-924916" not found

openshift-ingress

replicaset-controller

e2e-autores-84fdff-openshift-default-6db8f8c5d

SuccessfulCreate

Created pod: e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

openshift-ingress

deployment-controller

e2e-autores-84fdff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-84fdff-openshift-default-6db8f8c5d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-924916-75cdc8867c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-924916-75cdc8867c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-924916: serviceaccount "payload-processing-e2e-worker-w0-924916" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-1e4514fd-openshift-default-58dd9445d4

SuccessfulCreate

Created pod: e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

openshift-ingress

kubelet

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

Started

Started container istio-proxy

openshift-ingress

multus

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-1e4514fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1e4514fd

openshift-ingress

deployment-controller

e2e-ait-1e4514fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1e4514fd-openshift-default-58dd9445d4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-84fdff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-84fdff-b5c44f5bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-84fdff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-84fdff-bf594d749 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-84fdff-bf594d749

SuccessfulCreate

Created pod: payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-84fdff-bf594d749

FailedCreate

Error creating: pods "payload-processing-e2e-autores-84fdff-bf594d749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-84fdff: serviceaccount "payload-processing-e2e-autores-84fdff" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-84fdff: serviceaccount "payload-processing-e2e-autores-84fdff" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1e4514fd: serviceaccount "payload-processing-e2e-ait-1e4514fd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1e4514fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1e4514fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1e4514fd-95859dbd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1e4514fd-95859dbd7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1e4514fd-95859dbd7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1e4514fd-95859dbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1e4514fd: serviceaccount "payload-processing-e2e-ait-1e4514fd" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-d0b89a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d0b89a-openshift-default-97dff7896 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-d0b89a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-d0b89a-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-d0b89a-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d0b89a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d0b89a

openshift-ingress

multus

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-d0b89a-openshift-default-97dff7896

SuccessfulCreate

Created pod: e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

ProbeError

Readiness probe error: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d0b89a: serviceaccount "payload-processing-e2e-inf-b-d0b89a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d0b89a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d0b89a: serviceaccount "payload-processing-e2e-inf-b-d0b89a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d0b89a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d0b89a-7bbd5994bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-1e4514fd-openshift-default-58dd9445d4-5s8sw

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-1e4514fd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-1e4514fd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-1e4514fd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-1e4514fd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fdeb7e79-f555-4707-8e2f-cf83b5020acc, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-1e4514fd-95859dbd7-q7pj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1e4514fd-fc9dbb4b-cswwq

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-7cfdb2ad-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7cfdb2ad-gw

openshift-ingress

deployment-controller

e2e-migrate-7cfdb2ad-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb

SuccessfulCreate

Created pod: e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

openshift-ingress

multus

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7cfdb2ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7cfdb2ad: serviceaccount "payload-processing-e2e-migrate-7cfdb2ad" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7cfdb2ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7cfdb2ad: serviceaccount "payload-processing-e2e-migrate-7cfdb2ad" not found

openshift-ingress

multus

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

ProbeError

Readiness probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-7cfdb2ad-76b59fcc98-jhtt9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7cfdb2ad-5dbd7f8566-lr2zv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-5317692d-openshift-default-cf8ddf9fd

SuccessfulCreate

Created pod: e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

openshift-ingress

kubelet

e2e-migrate-7cfdb2ad-gw-openshift-default-6dc44b5bfb-fdb9h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-5317692d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5317692d

openshift-ingress

deployment-controller

e2e-ait-5317692d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5317692d-openshift-default-cf8ddf9fd from 0 to 1

openshift-ingress

multus

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5317692d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5317692d-5f79588665 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5317692d-5f79588665

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5317692d-5f79588665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5317692d: serviceaccount "payload-processing-e2e-ait-5317692d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5317692d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5317692d-59df4fcd5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

openshift-ingress

kubelet

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5317692d-5f79588665

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5317692d-5f79588665-rdztg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5317692d: serviceaccount "payload-processing-e2e-ait-5317692d" not found
(x2)

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5317692d-59df4fcd5d-78wn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5317692d-5f79588665-rdztg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-5317692d-openshift-default-cf8ddf9fd-vxpnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

e2e-derive-dfce3e96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-dfce3e96-openshift-default-5f447f79c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-dfce3e96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-dfce3e96

openshift-ingress

replicaset-controller

e2e-derive-dfce3e96-openshift-default-5f447f79c6

SuccessfulCreate

Created pod: e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

openshift-ingress

multus

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-dfce3e96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-84fdff

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-84fdff: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-84fdff": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-84fdff, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 71f7c770-4437-4ab7-a740-197074d17d24, UID in object meta:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-dfce3e96: serviceaccount "payload-processing-e2e-derive-dfce3e96" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-dfce3e96-767dcb9d57

FailedCreate

Error creating: pods "payload-processing-e2e-derive-dfce3e96-767dcb9d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-dfce3e96: serviceaccount "payload-processing-e2e-derive-dfce3e96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-84fdff-b5c44f5bb-nhpv9

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-dfce3e96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-dfce3e96-767dcb9d57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-dfce3e96-767dcb9d57

SuccessfulCreate

Created pod: payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

openshift-ingress

kubelet

payload-processing-e2e-autores-84fdff-bf594d749-qtxbk

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfce3e96-64c9f58b86-9btd4

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-dfce3e96-767dcb9d57-zjmfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-dfce3e96-openshift-default-5f447f79c6-65w6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-84fdff-openshift-default-6db8f8c5d-xw7wq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-7ce904-openshift-default-7868d4d5b

SuccessfulCreate

Created pod: e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

openshift-ingress

deployment-controller

e2e-explicit-7ce904-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7ce904-openshift-default-7868d4d5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-7ce904

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7ce904

openshift-ingress

multus

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7ce904

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7ce904-5978f7886 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7ce904-5978f7886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7ce904-5978f7886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7ce904: serviceaccount "payload-processing-e2e-explicit-7ce904" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7ce904-5978f7886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7ce904

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7ce904-5fcc754865 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7ce904-5fcc754865

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7ce904-5fcc754865

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7ce904-5fcc754865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7ce904: serviceaccount "payload-processing-e2e-explicit-7ce904" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-5e366590-openshift-default-77fb9896d

SuccessfulCreate

Created pod: e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

openshift-ingress

gateway_labeler_controller

e2e-mt-5e366590

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5e366590

openshift-ingress

deployment-controller

e2e-mt-5e366590-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5e366590-openshift-default-77fb9896d from 0 to 1

openshift-ingress

multus

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5e366590

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5e366590-7db9dc67c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5e366590

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5e366590-8448fbddd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5e366590-8448fbddd9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5e366590: serviceaccount "payload-processing-e2e-mt-5e366590" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5e366590-8448fbddd9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5e366590-8448fbddd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5e366590: serviceaccount "payload-processing-e2e-mt-5e366590" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ce904-5978f7886-qmgs4

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ce904-5fcc754865-46mq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-7ce904-openshift-default-7868d4d5b-nldw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-ec80c7-openshift-default-77cf4d84f6

SuccessfulCreate

Created pod: e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

openshift-ingress

deployment-controller

e2e-noten-ec80c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ec80c7-openshift-default-77cf4d84f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ec80c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ec80c7

openshift-ingress

kubelet

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:45746->10.132.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:45746->10.132.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e366590-7db9dc67c4-ls8lr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5e366590-8448fbddd9-ctg5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-5e366590-openshift-default-77fb9896d-w7dhm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4c2787

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4c2787

openshift-ingress

deployment-controller

e2e-shared-a-w2-4c2787-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb

SuccessfulCreate

Created pod: e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

openshift-ingress

multus

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4c2787

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4c2787

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4c2787: serviceaccount "payload-processing-e2e-shared-a-w2-4c2787" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4c2787: serviceaccount "payload-processing-e2e-shared-a-w2-4c2787" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2539c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2539c0

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd

SuccessfulCreate

Created pod: e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

openshift-ingress

deployment-controller

e2e-shared-b-w2-2539c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ec80c7-openshift-default-77cf4d84f6-t4g6f

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2539c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2539c0-d4647b86c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2539c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2539c0: serviceaccount "payload-processing-e2e-shared-b-w2-2539c0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2539c0: serviceaccount "payload-processing-e2e-shared-b-w2-2539c0" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-094dab-95bc57677-7r6nf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-094dab-6c6d699fd-tsv55

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-7b12b9e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7b12b9e3

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-7b12b9e3-openshift-default-554c95f56d

SuccessfulCreate

Created pod: e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

openshift-ingress

deployment-controller

e2e-mt-7b12b9e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7b12b9e3-openshift-default-554c95f56d from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-094dab-openshift-default-7d86774f74-gw2j4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7b12b9e3-756f69697

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7b12b9e3-756f69697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7b12b9e3: serviceaccount "payload-processing-e2e-mt-7b12b9e3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7b12b9e3: serviceaccount "payload-processing-e2e-mt-7b12b9e3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7b12b9e3-756f69697

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7b12b9e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7b12b9e3-756f69697 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7b12b9e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d0b89a-7bbd5994bc-zw6tk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d0b89a-686b784b8b-sd8w2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-9f88e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-9f88e1-openshift-default-578548bb46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-9f88e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9f88e1

openshift-ingress

multus

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46

SuccessfulCreate

Created pod: e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-d0b89a-openshift-default-97dff7896-ddz6r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-9f88e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9f88e1: serviceaccount "payload-processing-e2e-shared-a-w3-9f88e1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-9f88e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9f88e1: serviceaccount "payload-processing-e2e-shared-a-w3-9f88e1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-055ce3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-055ce3

openshift-ingress

replicaset-controller

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64

SuccessfulCreate

Created pod: e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

openshift-ingress

multus

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-055ce3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-055ce3-openshift-default-5bc88d64 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-055ce3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-055ce3: serviceaccount "payload-processing-e2e-shared-b-w3-055ce3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-055ce3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-055ce3: serviceaccount "payload-processing-e2e-shared-b-w3-055ce3" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.632s (1.632s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-7b12b9e3-756f69697-rsnrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7b12b9e3-59f86fcc58-st5f2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7b12b9e3-openshift-default-554c95f56d-4fpp6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-71d83f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-71d83f-openshift-default-5696c954cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-71d83f-openshift-default-5696c954cd

SuccessfulCreate

Created pod: e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

openshift-ingress

gateway_labeler_controller

e2e-api-a-71d83f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-71d83f

openshift-ingress

multus

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-71d83f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-71d83f-65dff8df78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-71d83f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-71d83f-86f8cf57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-71d83f-65dff8df78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-71d83f-65dff8df78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-71d83f: serviceaccount "payload-processing-e2e-api-a-71d83f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-71d83f-65dff8df78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

openshift-ingress

kubelet

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-71d83f-86f8cf57

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-71d83f-86f8cf57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-71d83f: serviceaccount "payload-processing-e2e-api-a-71d83f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-71d83f-86f8cf57

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-924916-575fb4b9c4-hr4wf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-924916-75cdc8867c-j6gk6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-924916-openshift-default-5c494577bb-mnskj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-f891c2-openshift-default-54c4dc76cb

SuccessfulCreate

Created pod: e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

openshift-ingress

deployment-controller

e2e-api-b-f891c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f891c2-openshift-default-54c4dc76cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f891c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f891c2

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f891c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f891c2-7695b99dd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f891c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f891c2-799c845ddb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f891c2-7695b99dd7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb
(x2)

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f891c2-7695b99dd7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f891c2-7695b99dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f891c2: serviceaccount "payload-processing-e2e-api-b-f891c2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f891c2-799c845ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f891c2-799c845ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f891c2: serviceaccount "payload-processing-e2e-api-b-f891c2" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f891c2-799c845ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d
(x6)

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-71d83f-65dff8df78-j7942

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-71d83f-86f8cf57-v5lfw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-71d83f-openshift-default-5696c954cd-lkhwh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-f891c2-7695b99dd7-dlspb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f891c2-799c845ddb-ltx8d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-5d484d-d76945b69-7sxj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-5d484d-b7f9f6786-f7dsz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f891c2-openshift-default-54c4dc76cb-fwmzt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-5d484d-openshift-default-8b7b595d-rnks4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c2787-677955c5cd-z4nmk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c2787-668fbc77c5-4vdsf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-4c2787

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4c2787: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-4c2787": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4c2787, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c1bacd81-1460-4cbe-8f6d-6d133f4d5821, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-4c2787-openshift-default-5c5ffc94fb-h72cm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2539c0-84b4946ff8-zffpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2539c0-d4647b86c-7bprx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-2539c0-openshift-default-7b6d6757bd-vnk8t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-a70ddb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a70ddb-openshift-default-7c7778968b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-a70ddb-openshift-default-7c7778968b

SuccessfulCreate

Created pod: e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a70ddb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a70ddb

openshift-ingress

multus

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a70ddb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a70ddb: serviceaccount "payload-processing-e2e-ipp-a-a70ddb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a70ddb: serviceaccount "payload-processing-e2e-ipp-a-a70ddb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a70ddb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96

SuccessfulCreate

Created pod: e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3eaa3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3eaa3c

openshift-ingress

deployment-controller

e2e-ipp-b-3eaa3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3eaa3c: serviceaccount "payload-processing-e2e-ipp-b-3eaa3c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3eaa3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3eaa3c: serviceaccount "payload-processing-e2e-ipp-b-3eaa3c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3eaa3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-a26a50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-a26a50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-a26a50

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50: serviceaccount "payload-processing-e2e-ipp-cleanup-a26a50" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-a26a50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a26a50: serviceaccount "payload-processing-e2e-ipp-cleanup-a26a50" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-a26a50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a26a50-6cd47b4758-msdr2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a26a50-5c66b4f7-278vf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-a26a50-openshift-default-7f6b8d74d6-jtmqh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a70ddb-6b9c8dfff8-xklw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a70ddb-6744fdcdbf-5z5jn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-a70ddb-openshift-default-7c7778968b-qwk86

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3eaa3c-5cf6485cf-fdw8b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3eaa3c-5b46784bcd-rhmjn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-3eaa3c-openshift-default-7d78b5bb96-jnrxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9f88e1-ffb9c457d-826jj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9f88e1-6f9487cbfc-pfxs6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-9f88e1-openshift-default-578548bb46-sj8z4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-055ce3-9474b8f4b-nz5p6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-055ce3-5bf4b97b95-qbrwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-055ce3-openshift-default-5bc88d64-6dnpz

Killing

Stopping container istio-proxy