Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl to ip-10-0-136-76.ec2.internal

openshift-ingress

kube-auth-proxy-d5c57f774-6wnxx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-d5c57f774-6wnxx to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6 to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8 to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq to ip-10-0-143-135.ec2.internal

openshift-ingress

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2 to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h to ip-10-0-136-76.ec2.internal

openshift-ingress

kube-auth-proxy-d5c57f774-9wsc8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-d5c57f774-9wsc8 to ip-10-0-143-135.ec2.internal

openshift-ingress

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n to ip-10-0-136-76.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-txwct

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-txwct to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz to ip-10-0-136-76.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c to ip-10-0-143-135.ec2.internal

openshift-ingress

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-70f06e-869f668c77-z9mx8 to ip-10-0-141-222.ec2.internal

openshift-ingress

router-default-86c7b86bcb-4jjm6

Scheduled

Successfully assigned openshift-ingress/router-default-86c7b86bcb-4jjm6 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82 to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6 to ip-10-0-141-222.ec2.internal

openshift-ingress

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Scheduled

Successfully assigned openshift-ingress/e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-pzffv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-pzffv to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd to ip-10-0-141-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs to ip-10-0-143-135.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2bw5x to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv to ip-10-0-136-76.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2 to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-qmrgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-qmrgz to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4 to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg to ip-10-0-143-135.ec2.internal

openshift-ingress

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Scheduled

Successfully assigned openshift-ingress/e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p to ip-10-0-143-135.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv to ip-10-0-136-76.ec2.internal

openshift-ingress

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l to ip-10-0-136-76.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-9lvdf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-9lvdf to ip-10-0-143-135.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-86c7b86bcb from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-86c7b86bcb

FailedCreate

Error creating: pods "router-default-86c7b86bcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-86c7b86bcb

FailedCreate

Error creating: pods "router-default-86c7b86bcb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-86c7b86bcb

SuccessfulCreate

Created pod: router-default-86c7b86bcb-4jjm6
(x6)

openshift-ingress

kubelet

router-default-86c7b86bcb-4jjm6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-86c7b86bcb-4jjm6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-86c7b86bcb-4jjm6

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-86c7b86bcb-4jjm6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-86c7b86bcb-4jjm6

Started

Started container router

openshift-ingress

kubelet

router-default-86c7b86bcb-4jjm6

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-d5c57f774

SuccessfulCreate

Created pod: kube-auth-proxy-d5c57f774-9wsc8

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-6wnxx

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-d5c57f774

SuccessfulCreate

Created pod: kube-auth-proxy-d5c57f774-6wnxx

openshift-ingress

replicaset-controller

kube-auth-proxy-d5c57f774

FailedCreate

Error creating: pods "kube-auth-proxy-d5c57f774-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-d5c57f774 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-d5c57f774-6wnxx

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-txwct

openshift-ingress

multus

kube-auth-proxy-d5c57f774-9wsc8

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-6wnxx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-9wsc8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-txwct

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-9wsc8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.802s (2.802s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-9wsc8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-9wsc8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-6wnxx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.551s (2.551s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-6wnxx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-d5c57f774-6wnxx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.447s (3.447s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.475s (2.475s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7mlmw

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-9lvdf

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-9lvdf

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9lvdf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9lvdf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.994s (2.994s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9lvdf

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9lvdf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txwct

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-txwct

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-2bw5x

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-qmrgz
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-pzffv

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzffv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-pzffv

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qmrgz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-qmrgz

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzffv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzffv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.484s (1.484s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzffv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qmrgz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qmrgz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qmrgz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.502s (1.502s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2bw5x

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-ed4c53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-ed4c53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-ed4c53

openshift-ingress

replicaset-controller

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b

SuccessfulCreate

Created pod: e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

openshift-ingress

replicaset-controller

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b

SuccessfulCreate

Created pod: e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

openshift-ingress

deployment-controller

e2e-worker-w4-377ca2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-377ca2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-377ca2

openshift-ingress

gateway_labeler_controller

e2e-inf-a-df2eb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-df2eb8

openshift-ingress

deployment-controller

e2e-inf-a-df2eb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-df2eb8-openshift-default-5b59ffcc88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88

SuccessfulCreate

Created pod: e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

openshift-ingress

multus

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-df2eb8-bf956d6cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-df2eb8: serviceaccount "payload-processing-e2e-inf-a-df2eb8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-df2eb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-df2eb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-df2eb8-bf956d6cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-df2eb8-bf956d6cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-df2eb8-bf956d6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-df2eb8: serviceaccount "payload-processing-e2e-inf-a-df2eb8" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-377ca2-ccf555f7c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-377ca2-ccf555f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-377ca2: serviceaccount "payload-processing-e2e-worker-w4-377ca2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-377ca2: serviceaccount "payload-processing-e2e-worker-w4-377ca2" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-377ca2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-377ca2-ccf555f7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-377ca2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-377ca2-ccf555f7c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 6.07s (6.07s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-autores-70f06e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-70f06e

openshift-ingress

deployment-controller

e2e-autores-70f06e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-70f06e-openshift-default-7947c6dcd from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-70f06e-openshift-default-7947c6dcd

SuccessfulCreate

Created pod: e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e095dac8-openshift-default-79d9d46f8b

SuccessfulCreate

Created pod: e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

openshift-ingress

gateway_labeler_controller

e2e-ait-e095dac8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e095dac8

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.374s (2.374s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-ait-e095dac8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e095dac8-openshift-default-79d9d46f8b from 0 to 1

openshift-ingress

multus

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.728s (2.728s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-ed4c53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-ed4c53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-ed4c53-6fcb85d75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ed4c53: serviceaccount "payload-processing-e2e-worker-w0-ed4c53" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ed4c53: serviceaccount "payload-processing-e2e-worker-w0-ed4c53" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.134s (1.134s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-70f06e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-70f06e-869f668c77 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-70f06e-8d6b74974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-70f06e-8d6b74974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-70f06e-8d6b74974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-70f06e: serviceaccount "payload-processing-e2e-autores-70f06e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-70f06e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-70f06e-8d6b74974 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-70f06e-869f668c77

FailedCreate

Error creating: pods "payload-processing-e2e-autores-70f06e-869f668c77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-70f06e: serviceaccount "payload-processing-e2e-autores-70f06e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-70f06e-869f668c77

SuccessfulCreate

Created pod: payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b63f26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b63f26

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e095dac8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e095dac8-c668f4fb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e095dac8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e095dac8-697fb5f646 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-b63f26-openshift-default-68c8cb6d54

SuccessfulCreate

Created pod: e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e095dac8-697fb5f646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

openshift-ingress

multus

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-b63f26

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-b63f26-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-b63f26-authn-ssl" already exists
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e095dac8-697fb5f646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e095dac8-697fb5f646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e095dac8: serviceaccount "payload-processing-e2e-ait-e095dac8" not found

openshift-ingress

deployment-controller

e2e-inf-b-b63f26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b63f26-openshift-default-68c8cb6d54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e095dac8-c668f4fb5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e095dac8-c668f4fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e095dac8: serviceaccount "payload-processing-e2e-ait-e095dac8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e095dac8-c668f4fb5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

openshift-ingress

multus

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Created

Created container: istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b63f26: serviceaccount "payload-processing-e2e-inf-b-b63f26" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b63f26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b63f26-fd596bb8f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b63f26-fd596bb8f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b63f26-fd596bb8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b63f26: serviceaccount "payload-processing-e2e-inf-b-b63f26" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b63f26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b63f26-fd596bb8f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-e095dac8-c668f4fb5-h9qcx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e095dac8-697fb5f646-jhmb8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e095dac8-openshift-default-79d9d46f8b-9rhjr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8

SuccessfulCreate

Created pod: e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

openshift-ingress

deployment-controller

e2e-migrate-3675964e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3675964e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3675964e-gw

openshift-ingress

multus

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3675964e-6cb89d497d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3675964e-6cb89d497d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3675964e: serviceaccount "payload-processing-e2e-migrate-3675964e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3675964e-79c857d598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3675964e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3675964e-79c857d598 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3675964e-79c857d598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3675964e-79c857d598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3675964e: serviceaccount "payload-processing-e2e-migrate-3675964e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3675964e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3675964e-6cb89d497d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3675964e-6cb89d497d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch
(x2)

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

ProbeError

Startup probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-migrate-3675964e-6cb89d497d-sd6ch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-3675964e-gw-openshift-default-77f6cdf7d8-2tptv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3675964e-79c857d598-glnkw

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-feff2644

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-feff2644

openshift-ingress

deployment-controller

e2e-ait-feff2644-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-feff2644-openshift-default-749cbc587d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-feff2644-openshift-default-749cbc587d

SuccessfulCreate

Created pod: e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

openshift-ingress

multus

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-feff2644-84b6cf597c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

openshift-ingress

deployment-controller

payload-processing-e2e-ait-feff2644

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-feff2644-84b6cf597c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-feff2644: serviceaccount "payload-processing-e2e-ait-feff2644" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-feff2644-84b6cf597c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-feff2644-84b6cf597c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-feff2644: serviceaccount "payload-processing-e2e-ait-feff2644" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-feff2644

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-feff2644-84b6cf597c-5rw8v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feff2644-7c6f4fbd7d-z8wn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-feff2644-openshift-default-749cbc587d-pqv6z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-df538fee-openshift-default-77b5b8d9d4

SuccessfulCreate

Created pod: e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

openshift-ingress

deployment-controller

e2e-derive-df538fee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-df538fee-openshift-default-77b5b8d9d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-df538fee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-df538fee

openshift-ingress

multus

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-df538fee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-df538fee-6b48b76b69 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-df538fee: serviceaccount "payload-processing-e2e-derive-df538fee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-df538fee-6b48b76b69

SuccessfulCreate

Created pod: payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-df538fee-6b48b76b69

FailedCreate

Error creating: pods "payload-processing-e2e-derive-df538fee-6b48b76b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-df538fee: serviceaccount "payload-processing-e2e-derive-df538fee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-df538fee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-df538fee-85f65b6d9d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-70f06e-869f668c77-z9mx8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-70f06e-8d6b74974-qshdd

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-df538fee-6b48b76b69-8x6ll

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-df538fee-85f65b6d9d-lt75w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-df538fee-openshift-default-dockercfg-dcqk6); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-df538fee-openshift-default-77b5b8d9d4-vw24p

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-0aac26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0aac26

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-0aac26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0aac26-openshift-default-587dbf4d56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-0aac26-openshift-default-587dbf4d56

SuccessfulCreate

Created pod: e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-70f06e-openshift-default-7947c6dcd-4jl8c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0aac26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0aac26-9b87f8bcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0aac26-9b87f8bcc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0aac26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0aac26-79cfc5f646 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0aac26-9b87f8bcc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0aac26-9b87f8bcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0aac26: serviceaccount "payload-processing-e2e-explicit-0aac26" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0aac26: serviceaccount "payload-processing-e2e-explicit-0aac26" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-f1bc6110

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f1bc6110

openshift-ingress

replicaset-controller

e2e-mt-f1bc6110-openshift-default-846bb576b4

SuccessfulCreate

Created pod: e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

openshift-ingress

multus

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-f1bc6110-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f1bc6110-openshift-default-846bb576b4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f1bc6110: serviceaccount "payload-processing-e2e-mt-f1bc6110" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f1bc6110

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f1bc6110

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f1bc6110-5f9b978cd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f1bc6110-5f9b978cd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f1bc6110-5f9b978cd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f1bc6110: serviceaccount "payload-processing-e2e-mt-f1bc6110" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f1bc6110-5f9b978cd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-f1bc6110-5f9b978cd5-n96rq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-f1bc6110

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-f1bc6110": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-f1bc6110, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 49b9a888-51c6-4976-8cbe-d0d367bfef7e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f1bc6110-74fb5d684b-29lhz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f1bc6110-openshift-default-846bb576b4-hvcnq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e46fbf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e46fbf

openshift-ingress

deployment-controller

e2e-shared-a-w2-e46fbf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b

SuccessfulCreate

Created pod: e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

openshift-ingress

multus

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aac26-9b87f8bcc-6f7nk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aac26-79cfc5f646-bjm89

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e46fbf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e46fbf: serviceaccount "payload-processing-e2e-shared-a-w2-e46fbf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e46fbf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e46fbf: serviceaccount "payload-processing-e2e-shared-a-w2-e46fbf" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ac71f8-openshift-default-765c64f6d4

SuccessfulCreate

Created pod: e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

openshift-ingress

deployment-controller

e2e-noten-ac71f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ac71f8-openshift-default-765c64f6d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ac71f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ac71f8

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-0aac26-openshift-default-587dbf4d56-f2dqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-55bd4d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-55bd4d

openshift-ingress

deployment-controller

e2e-shared-b-w2-55bd4d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d

SuccessfulCreate

Created pod: e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

openshift-ingress

multus

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55bd4d: serviceaccount "payload-processing-e2e-shared-b-w2-55bd4d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55bd4d: serviceaccount "payload-processing-e2e-shared-b-w2-55bd4d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-55bd4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-55bd4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-df2eb8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-df2eb8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-df2eb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 167aafa3-7cfe-432a-ac9c-158e4e33bd32, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df2eb8-bf956d6cf-x9fjl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df2eb8-77c955dd9d-4qn9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-df2eb8-openshift-default-5b59ffcc88-6hw7n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-bfd52075-openshift-default-78f9d66ccb

SuccessfulCreate

Created pod: e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-mt-bfd52075

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bfd52075

openshift-ingress

deployment-controller

e2e-mt-bfd52075-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bfd52075-openshift-default-78f9d66ccb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bfd52075

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bfd52075-658b4cffd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bfd52075-658b4cffd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bfd52075-658b4cffd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bfd52075: serviceaccount "payload-processing-e2e-mt-bfd52075" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bfd52075-658b4cffd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bfd52075: serviceaccount "payload-processing-e2e-mt-bfd52075" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bfd52075

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b63f26-65bd777cc4-z8cfp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b63f26-fd596bb8f-fhz8b

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-b63f26-openshift-default-68c8cb6d54-dmhsd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-783872

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-783872

openshift-ingress

deployment-controller

e2e-shared-a-w3-783872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-783872-openshift-default-7f455f4dc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4

SuccessfulCreate

Created pod: e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

openshift-ingress

multus

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-783872

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-783872: serviceaccount "payload-processing-e2e-shared-a-w3-783872" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-783872

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-783872-668dc565db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-783872: serviceaccount "payload-processing-e2e-shared-a-w3-783872" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ac71f8-openshift-default-765c64f6d4-lcf6h

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": read tcp 10.132.0.2:35852->10.132.0.74:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": read tcp 10.132.0.2:35852->10.132.0.74:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb

SuccessfulCreate

Created pod: e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-1a4b6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-1a4b6d

openshift-ingress

deployment-controller

e2e-shared-b-w3-1a4b6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-1a4b6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-1a4b6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d: serviceaccount "payload-processing-e2e-shared-b-w3-1a4b6d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-1a4b6d: serviceaccount "payload-processing-e2e-shared-b-w3-1a4b6d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bfd52075-847d4c4ddb-s62lt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bfd52075-658b4cffd5-pckqz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-bfd52075-openshift-default-78f9d66ccb-hp96h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-ca1331-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ca1331-openshift-default-789b5fcbc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-ca1331-openshift-default-789b5fcbc6

SuccessfulCreate

Created pod: e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

openshift-ingress

gateway_labeler_controller

e2e-api-a-ca1331

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ca1331

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ed4c53-6fcb85d75-ktlhx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ed4c53-59f4997598-7jfng

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ca1331-6cbd96474c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ca1331-6cbd96474c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ca1331: serviceaccount "payload-processing-e2e-api-a-ca1331" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ca1331

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ca1331-6cbd96474c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ca1331

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ca1331: serviceaccount "payload-processing-e2e-api-a-ca1331" not found

openshift-ingress

multus

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ca1331-6cbd96474c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

openshift-ingress

kubelet

e2e-worker-w0-ed4c53-openshift-default-57c6d78c9b-2pbk4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-eb3054-openshift-default-58876c59cb

SuccessfulCreate

Created pod: e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

openshift-ingress

deployment-controller

e2e-api-b-eb3054-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-eb3054-openshift-default-58876c59cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-eb3054

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-eb3054

openshift-ingress

multus

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eb3054: serviceaccount "payload-processing-e2e-api-b-eb3054" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-eb3054

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-eb3054-f8d84f76c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eb3054-f8d84f76c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eb3054-f8d84f76c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-eb3054-f8d84f76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eb3054: serviceaccount "payload-processing-e2e-api-b-eb3054" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-eb3054

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca1331-5cfd7b7d78-tttxp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-ca1331

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-ca1331: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-ca1331": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-ca1331, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d9c30803-b756-4f8d-84ca-e40eeef5c335, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca1331-6cbd96474c-kh2rk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-ca1331-openshift-default-789b5fcbc6-zj8l2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-377ca2-ccf555f7c-hr8cg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-377ca2-d8fb4985d-7g4lv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-377ca2-openshift-default-58c9bb4f6b-b887l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-eb3054-f8d84f76c-7htgp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eb3054-b95bb9dcd-qqqqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-eb3054-openshift-default-58876c59cb-qxb8c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e46fbf-7d645454dc-nmptd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e46fbf-6d7f57c9fd-f2khq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-e46fbf-openshift-default-7d85569b9b-z5snz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55bd4d-575cdbb778-khkgn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55bd4d-5f9d956479-qfgcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-55bd4d-openshift-default-5b975c7b4d-n89f6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-b6289c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b6289c-openshift-default-57dc857d54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b6289c-openshift-default-57dc857d54

SuccessfulCreate

Created pod: e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b6289c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b6289c

openshift-ingress

multus

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b6289c-556867478f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b6289c-556867478f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b6289c: serviceaccount "payload-processing-e2e-ipp-a-b6289c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b6289c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b6289c-556867478f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b6289c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b6289c-556867478f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b6289c: serviceaccount "payload-processing-e2e-ipp-a-b6289c" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-9d6301

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-9d6301-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-9d6301-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9d6301

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9d6301

openshift-ingress

deployment-controller

e2e-ipp-b-9d6301-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9d6301-openshift-default-76bc4f88b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-9d6301-openshift-default-76bc4f88b

SuccessfulCreate

Created pod: e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

openshift-ingress

multus

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d6301: serviceaccount "payload-processing-e2e-ipp-b-9d6301" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9d6301

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9d6301-5c75f5976f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d6301-5c75f5976f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d6301-5c75f5976f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9d6301-5c75f5976f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d6301: serviceaccount "payload-processing-e2e-ipp-b-9d6301" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9d6301

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cafbd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cafbd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cafbd6

openshift-ingress

multus

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6: serviceaccount "payload-processing-e2e-ipp-cleanup-cafbd6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cafbd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cafbd6: serviceaccount "payload-processing-e2e-ipp-cleanup-cafbd6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cafbd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cafbd6-69cc64dc6b-dsl77

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cafbd6-799665f59f-7cgfl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-cafbd6-openshift-default-54644c8bfb-twr8l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b6289c-556867478f-nr4pc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b6289c-5fcfd4c9f8-vjlm5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-b6289c-openshift-default-57dc857d54-txqzz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d6301-5c75f5976f-sfk5w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d6301-6b548647c4-mc4tj

Unhealthy

Readiness probe failed: dial tcp 10.132.0.89:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-9d6301-openshift-default-76bc4f88b-9bn82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-783872-668dc565db-cktw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-783872-6f4df5bf5c-bwdzv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-783872-openshift-default-7f455f4dc4-cn85h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1a4b6d-565b576c7c-p78cv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1a4b6d-9d4466fbb-cqlvg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-1a4b6d-openshift-default-6d4bbf7ddb-88qs2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: