Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7 to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2 to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8 to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4 to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Scheduled

Successfully assigned openshift-ingress/e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8 to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6 to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks to ip-10-0-128-111.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4178a6-openshift-default-596589786-tm9nc to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld to ip-10-0-128-111.ec2.internal

openshift-ingress

kube-auth-proxy-6f86d6bc5-9c7x6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f86d6bc5-9c7x6 to ip-10-0-143-48.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-gdrj9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-gdrj9 to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l to ip-10-0-128-111.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6pdc5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6pdc5 to ip-10-0-143-48.ec2.internal

openshift-ingress

kube-auth-proxy-6f86d6bc5-hqmmj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f86d6bc5-hqmmj to ip-10-0-128-111.ec2.internal

openshift-ingress

router-default-9bc99d698-k2qmx

Scheduled

Successfully assigned openshift-ingress/router-default-9bc99d698-k2qmx to ip-10-0-143-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-pre-processing-6cd864bc95-vrcw8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6cd864bc95-vrcw8 to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-5d7dbbd56b-p6mx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-5d7dbbd56b-p6mx9 to ip-10-0-143-48.ec2.internal

openshift-ingress

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-06e75986-openshift-default-7964f68676-st2jq to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-d4lm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-d4lm4 to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-59smc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-59smc to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp to ip-10-0-137-62.ec2.internal

openshift-ingress

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5 to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs to ip-10-0-128-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9 to ip-10-0-128-111.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xjmsh to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp to ip-10-0-137-62.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld to ip-10-0-128-111.ec2.internal

openshift-ingress

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k to ip-10-0-137-62.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-9bc99d698 from 0 to 1
(x14)

openshift-ingress

replicaset-controller

router-default-9bc99d698

FailedCreate

Error creating: pods "router-default-9bc99d698-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-9bc99d698

FailedCreate

Error creating: pods "router-default-9bc99d698-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-9bc99d698

SuccessfulCreate

Created pod: router-default-9bc99d698-k2qmx
(x6)

openshift-ingress

kubelet

router-default-9bc99d698-k2qmx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-9bc99d698-k2qmx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-9bc99d698-k2qmx

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-9bc99d698-k2qmx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-9bc99d698-k2qmx

Created

Created container: router

openshift-ingress

kubelet

router-default-9bc99d698-k2qmx

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6f86d6bc5 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-hqmmj

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6f86d6bc5

SuccessfulCreate

Created pod: kube-auth-proxy-6f86d6bc5-hqmmj
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-6f86d6bc5

FailedCreate

Error creating: pods "kube-auth-proxy-6f86d6bc5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6f86d6bc5

SuccessfulCreate

Created pod: kube-auth-proxy-6f86d6bc5-9c7x6

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-9c7x6

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-9c7x6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6f86d6bc5-9c7x6

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6f86d6bc5-hqmmj

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-hqmmj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6pdc5

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6pdc5

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6pdc5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-hqmmj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-hqmmj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-hqmmj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.834s (2.834s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-9c7x6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6pdc5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6pdc5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6pdc5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.478s (3.478s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-9c7x6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f86d6bc5-9c7x6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.107s (4.107s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.691s (2.691s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8z4xl

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-gdrj9

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-gdrj9

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gdrj9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gdrj9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.631s (2.631s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gdrj9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gdrj9

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6pdc5

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6pdc5
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-xjmsh

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.671s (2.671s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-d4lm4

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-59smc

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-59smc

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-59smc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4lm4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-d4lm4

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-59smc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-59smc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-59smc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.36s (1.36s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4lm4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4lm4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4lm4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.314s (1.314s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Unhealthy

Readiness probe failed: Get "http://10.134.0.24:15021/healthz/ready": read tcp 10.134.0.2:52546->10.134.0.24:15021: read: connection reset by peer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

ProbeError

Readiness probe error: Get "http://10.134.0.24:15021/healthz/ready": read tcp 10.134.0.2:52546->10.134.0.24:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

Unhealthy

Startup probe failed: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-xjmsh

ProbeError

Startup probe error: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4lm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-59smc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-6cd864bc95

SuccessfulCreate

Created pod: payload-pre-processing-6cd864bc95-vrcw8

openshift-ingress

replicaset-controller

payload-processing-5d7dbbd56b

SuccessfulCreate

Created pod: payload-processing-5d7dbbd56b-p6mx9

openshift-ingress

multus

payload-pre-processing-6cd864bc95-vrcw8

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-p6mx9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5d7dbbd56b-p6mx9

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6cd864bc95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5d7dbbd56b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-vrcw8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-p6mx9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-p6mx9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-vrcw8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.054s (1.054s including waiting). Image size: 141123057 bytes.

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-vrcw8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-vrcw8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-p6mx9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.089s (1.089s including waiting). Image size: 141123057 bytes.

openshift-ingress

replicaset-controller

e2e-worker-w0-5b59aa-openshift-default-ff449c75d

SuccessfulCreate

Created pod: e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

openshift-ingress

replicaset-controller

e2e-inf-a-6dfb47-openshift-default-6f589b7f88

SuccessfulCreate

Created pod: e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

openshift-ingress

multus

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-a3d7eb-openshift-default-575f759d98

SuccessfulCreate

Created pod: e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

openshift-ingress

deployment-controller

e2e-worker-w3-a3d7eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a3d7eb-openshift-default-575f759d98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-a3d7eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-a3d7eb

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6dfb47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6dfb47

openshift-ingress

multus

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-6dfb47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6dfb47-openshift-default-6f589b7f88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-5b59aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-5b59aa

openshift-ingress

deployment-controller

e2e-worker-w0-5b59aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5b59aa-openshift-default-ff449c75d from 0 to 1

openshift-ingress

multus

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6dfb47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6dfb47-5956794775

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6dfb47-5956794775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6dfb47: serviceaccount "payload-processing-e2e-inf-a-6dfb47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6dfb47-5956794775

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6dfb47: serviceaccount "payload-processing-e2e-inf-a-6dfb47" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6dfb47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6dfb47-5956794775 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb: serviceaccount "payload-processing-e2e-worker-w3-a3d7eb" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a3d7eb-7877b996df

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-a3d7eb-7877b996df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a3d7eb: serviceaccount "payload-processing-e2e-worker-w3-a3d7eb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a3d7eb-7877b996df

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-a3d7eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-a3d7eb-7877b996df from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-a3d7eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5b59aa: serviceaccount "payload-processing-e2e-worker-w0-5b59aa" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5b59aa: serviceaccount "payload-processing-e2e-worker-w0-5b59aa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-5b59aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-5b59aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-5b59aa-6679fcd48f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.406s (1.406s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-da6c4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-da6c4f-openshift-default-7d6598f44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-da6c4f-openshift-default-7d6598f44

SuccessfulCreate

Created pod: e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

openshift-ingress

gateway_labeler_controller

e2e-inf-b-da6c4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-da6c4f

openshift-ingress

multus

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-da6c4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-da6c4f-7d7768c479 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da6c4f-7d7768c479

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da6c4f: serviceaccount "payload-processing-e2e-inf-b-da6c4f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-da6c4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da6c4f-7d7768c479

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-da6c4f-7d7768c479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da6c4f: serviceaccount "payload-processing-e2e-inf-b-da6c4f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-06e75986-openshift-default-7964f68676

SuccessfulCreate

Created pod: e2e-ait-06e75986-openshift-default-7964f68676-st2jq

openshift-ingress

deployment-controller

e2e-ait-06e75986-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-06e75986-openshift-default-7964f68676 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-06e75986

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-06e75986

openshift-ingress

multus

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-06e75986: serviceaccount "payload-processing-e2e-ait-06e75986" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-06e75986-5f9fc5bb8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-06e75986-5f9fc5bb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-06e75986: serviceaccount "payload-processing-e2e-ait-06e75986" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-06e75986

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-06e75986-5f9fc5bb8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-06e75986

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-06e75986-5f9fc5bb8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dfb47-5956794775-bflc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dfb47-6fb6f6dc4-ppwrw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-6dfb47

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-6dfb47": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-6dfb47, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bd76e9e2-a040-44f0-ac89-aef95f7a3455, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-06e75986-5f9fc5bb8c-8k7rg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-06e75986-6c9fc5c47d-86q2r

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-06e75986

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-06e75986: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-06e75986": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-06e75986, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7b0e3c0d-8dbf-44f2-adab-f78b4c31dc34, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-c40df7fa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c40df7fa-gw
(x2)

openshift-ingress

kubelet

e2e-ait-06e75986-openshift-default-7964f68676-st2jq

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-migrate-c40df7fa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56

SuccessfulCreate

Created pod: e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-c40df7fa-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-c40df7fa-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-c40df7fa-gw-authn-ssl" already exists

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6dfb47-openshift-default-6f589b7f88-5qnxp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Started

Started container istio-proxy

openshift-ingress

multus

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

openshift-ingress

multus

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c40df7fa: serviceaccount "payload-processing-e2e-migrate-c40df7fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c40df7fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c40df7fa: serviceaccount "payload-processing-e2e-migrate-c40df7fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c40df7fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da6c4f-7d7768c479-nc9hn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da6c4f-79c4c854b-vkd9b

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-da6c4f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-da6c4f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-da6c4f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-da6c4f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f5a81445-0519-4670-a962-4c3b7aed6ce3, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-db1ed7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-db1ed7

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b

SuccessfulCreate

Created pod: e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

openshift-ingress

deployment-controller

e2e-shared-a-w2-db1ed7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-da6c4f-openshift-default-7d6598f44-fg5qr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7: serviceaccount "payload-processing-e2e-shared-a-w2-db1ed7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-db1ed7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-db1ed7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-db1ed7: serviceaccount "payload-processing-e2e-shared-a-w2-db1ed7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

endpoint-controller

payload-processing-e2e-migrate-c40df7fa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-migrate-c40df7fa: Operation cannot be fulfilled on endpoints "payload-processing-e2e-migrate-c40df7fa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-migrate-c40df7fa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 28d4aeab-ec16-4caf-93da-cd49a027d0e0, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c40df7fa-744b64f7f8-m67g8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c40df7fa-7bdb8b9b86-4mnld

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-b099417d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b099417d-openshift-default-7c4dc99d7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-b099417d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b099417d

openshift-ingress

replicaset-controller

e2e-ait-b099417d-openshift-default-7c4dc99d7b

SuccessfulCreate

Created pod: e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

openshift-ingress

multus

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-c40df7fa-gw-openshift-default-7cc77b5b56-ms4hd

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b099417d: serviceaccount "payload-processing-e2e-ait-b099417d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b099417d-5d6fb6b6c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b099417d-5d6fb6b6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b099417d: serviceaccount "payload-processing-e2e-ait-b099417d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b099417d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b099417d-7744cc6bc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b099417d-5d6fb6b6c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b099417d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b099417d-5d6fb6b6c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-eee708

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-eee708

openshift-ingress

multus

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb

SuccessfulCreate

Created pod: e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

openshift-ingress

deployment-controller

e2e-shared-b-w2-eee708-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-eee708-78849d699f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-eee708

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-eee708-78849d699f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-eee708: serviceaccount "payload-processing-e2e-shared-b-w2-eee708" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-eee708-78849d699f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-eee708-78849d699f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-eee708: serviceaccount "payload-processing-e2e-shared-b-w2-eee708" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-eee708

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b099417d-7744cc6bc8-zdfcd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-b099417d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-b099417d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-b099417d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-b099417d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6cc084fb-41fe-49fa-98cc-7de3215a6739, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-b099417d-5d6fb6b6c5-q2hzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b099417d-openshift-default-7c4dc99d7b-plbvp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-642a8155

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-642a8155

openshift-ingress

deployment-controller

e2e-derive-642a8155-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-642a8155-openshift-default-5fc74f4f8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-642a8155-openshift-default-5fc74f4f8d

SuccessfulCreate

Created pod: e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-642a8155

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-642a8155-756f57f47c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-642a8155-756f57f47c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-642a8155-756f57f47c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-642a8155-756f57f47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-642a8155: serviceaccount "payload-processing-e2e-derive-642a8155" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-642a8155

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-642a8155-67d6745478 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-642a8155-67d6745478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-642a8155-67d6745478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-642a8155-67d6745478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-642a8155: serviceaccount "payload-processing-e2e-derive-642a8155" not found
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-642a8155-756f57f47c-gwjv8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-642a8155-67d6745478-9lllv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-642a8155-openshift-default-5fc74f4f8d-ntwqg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a3d7eb-7877b996df-jzk2x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a3d7eb-7d978f66b6-grvkp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w3-a3d7eb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w3-a3d7eb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w3-a3d7eb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e909c3bf-0735-4e9f-97ed-8f3576409e68, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a3d7eb-openshift-default-575f759d98-8r69k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5b59aa-786d4c9486-fp9xw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5b59aa-6679fcd48f-g84zz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-efdec406

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-efdec406

openshift-ingress

replicaset-controller

e2e-mt-efdec406-openshift-default-5b47f96b76

SuccessfulCreate

Created pod: e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

openshift-ingress

deployment-controller

e2e-mt-efdec406-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-efdec406-openshift-default-5b47f96b76 from 0 to 1

openshift-ingress

multus

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-efdec406-f765b5bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

openshift-ingress

kubelet

e2e-worker-w0-5b59aa-openshift-default-ff449c75d-6ckh5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-efdec406

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-efdec406-676548c658 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-efdec406-676548c658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-efdec406-676548c658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-efdec406-676548c658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-efdec406: serviceaccount "payload-processing-e2e-mt-efdec406" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-efdec406

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-efdec406-f765b5bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-efdec406-f765b5bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-efdec406-f765b5bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-efdec406: serviceaccount "payload-processing-e2e-mt-efdec406" not found

openshift-ingress

multus

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-efdec406-f765b5bf-rbj7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-efdec406-676548c658-5j5qm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-efdec406-openshift-default-5b47f96b76-mvmd7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d

SuccessfulCreate

Created pod: e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

openshift-ingress

deployment-controller

e2e-shared-a-w1-fe9d17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-fe9d17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-fe9d17

openshift-ingress

multus

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fe9d17: serviceaccount "payload-processing-e2e-shared-a-w1-fe9d17" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fe9d17: serviceaccount "payload-processing-e2e-shared-a-w1-fe9d17" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-fe9d17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-fe9d17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd

SuccessfulCreate

Created pod: e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

openshift-ingress

multus

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-e86d9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-e86d9e

openshift-ingress

deployment-controller

e2e-shared-b-w1-e86d9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-e86d9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-e86d9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e: serviceaccount "payload-processing-e2e-shared-b-w1-e86d9e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e86d9e: serviceaccount "payload-processing-e2e-shared-b-w1-e86d9e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-73bfc1e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-73bfc1e9

openshift-ingress

replicaset-controller

e2e-mt-73bfc1e9-openshift-default-fc75695d8

SuccessfulCreate

Created pod: e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

openshift-ingress

deployment-controller

e2e-mt-73bfc1e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-73bfc1e9-openshift-default-fc75695d8 from 0 to 1

openshift-ingress

multus

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-73bfc1e9-76785bdc57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-73bfc1e9-76785bdc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-73bfc1e9: serviceaccount "payload-processing-e2e-mt-73bfc1e9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-73bfc1e9: serviceaccount "payload-processing-e2e-mt-73bfc1e9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-73bfc1e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-73bfc1e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-73bfc1e9-76785bdc57 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-73bfc1e9-76785bdc57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-73bfc1e9-5fbfd6874b-lkwmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-73bfc1e9-76785bdc57-lh87l

Unhealthy

Readiness probe failed: dial tcp 10.134.0.62:9004: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-10a6b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-10a6b9-openshift-default-59c8c8d596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-10a6b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-10a6b9

openshift-ingress

multus

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596

SuccessfulCreate

Created pod: e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10a6b9-6d95c69487

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-10a6b9-6d95c69487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10a6b9: serviceaccount "payload-processing-e2e-ipp-a-10a6b9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10a6b9: serviceaccount "payload-processing-e2e-ipp-a-10a6b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-10a6b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-10a6b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-10a6b9-6d95c69487 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10a6b9-6d95c69487

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-73bfc1e9-openshift-default-fc75695d8-8l6ww

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4fe974

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4fe974

openshift-ingress

deployment-controller

e2e-ipp-b-4fe974-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4fe974-openshift-default-59b7dbcd46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46

SuccessfulCreate

Created pod: e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz
(x6)

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4fe974

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4fe974-5c5d79b89c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4fe974

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4fe974: serviceaccount "payload-processing-e2e-ipp-b-4fe974" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4fe974: serviceaccount "payload-processing-e2e-ipp-b-4fe974" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-4178a6-openshift-default-596589786

SuccessfulCreate

Created pod: e2e-api-a-4178a6-openshift-default-596589786-tm9nc

openshift-ingress

deployment-controller

e2e-api-a-4178a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4178a6-openshift-default-596589786 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-4178a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4178a6

openshift-ingress

multus

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4178a6-66b5858d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4178a6-66b5858d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4178a6: serviceaccount "payload-processing-e2e-api-a-4178a6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4178a6-67c58859d5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4178a6-67c58859d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4178a6: serviceaccount "payload-processing-e2e-api-a-4178a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4178a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4178a6-66b5858d78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4178a6-66b5858d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4178a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4178a6-67c58859d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4178a6-67c58859d5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-1a50f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1a50f4

openshift-ingress

deployment-controller

e2e-api-b-1a50f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1a50f4-openshift-default-cdcf58b5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-1a50f4-openshift-default-cdcf58b5b

SuccessfulCreate

Created pod: e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

openshift-ingress

multus

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1a50f4: serviceaccount "payload-processing-e2e-api-b-1a50f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1a50f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1a50f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1a50f4-77695f75c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1a50f4-77695f75c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1a50f4-77695f75c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1a50f4-77695f75c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1a50f4: serviceaccount "payload-processing-e2e-api-b-1a50f4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-342933

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-342933

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544

SuccessfulCreate

Created pod: e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

openshift-ingress

deployment-controller

e2e-ipp-cleanup-342933-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-342933-openshift-default-66f6f7b544 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-342933: serviceaccount "payload-processing-e2e-ipp-cleanup-342933" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-342933: serviceaccount "payload-processing-e2e-ipp-cleanup-342933" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-342933

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-342933-5884dfdb95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-342933

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4178a6-67c58859d5-mc9tp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4178a6-66b5858d78-fdlkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-4178a6-openshift-default-596589786-tm9nc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-342933-5884dfdb95-npwr9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-342933

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-342933": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-342933, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7c91bf33-d795-4cc9-a5a8-0f3609b68847, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-342933-7c967b7cf8-65hfc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-1a50f4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-1a50f4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-1a50f4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 32a0b882-47a2-4687-9adf-af3685edb93e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1a50f4-7d576bffd6-kjdgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1a50f4-77695f75c9-dfqks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-342933-openshift-default-66f6f7b544-c5hzx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-1a50f4-openshift-default-cdcf58b5b-7rhbf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fe9d17-7bfbc46f4b-ftn6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fe9d17-6b5dbf5695-rxrld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10a6b9-df8c98746-r8sl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10a6b9-6d95c69487-gqtzm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-fe9d17-openshift-default-7c99c6db4d-8qcp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e86d9e-7b45555b5d-m8trk

Unhealthy

Readiness probe failed: dial tcp 10.133.0.74:9004: i/o timeout

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e86d9e-6fb7454575-nml7l

Unhealthy

Readiness probe failed: dial tcp 10.133.0.75:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-e86d9e-openshift-default-65bf4ddbdd-jnrbq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-10a6b9-openshift-default-59c8c8d596-v5hps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4fe974-659977f8c4-926tc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.68:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4fe974-5c5d79b89c-jfqrs

Unhealthy

Readiness probe failed: dial tcp 10.134.0.69:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-4fe974-openshift-default-59b7dbcd46-cpkvz

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-db1ed7-57b4fc7f46-6jjzx

Unhealthy

Readiness probe failed: dial tcp 10.134.0.46:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Unhealthy

Readiness probe failed: dial tcp 10.133.0.63:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-db1ed7-7f4849f747-xph9x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-db1ed7-openshift-default-76d965fc7b-jx9rd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-eee708-67fffc7694-ngjhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-eee708-78849d699f-lm2ks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-eee708-openshift-default-7df5ffbcb-7qg8r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x22)

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-vrcw8

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-7v8jt); attempting to pull the image may not succeed.
(x22)

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-p6mx9

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-7v8jt); attempting to pull the image may not succeed.