Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-85dcd64b9c-tgw8z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85dcd64b9c-tgw8z to ip-10-0-128-41.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5 to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-53471f-5689c77947-5d2jd to ip-10-0-131-209.ec2.internal

openshift-ingress

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bbcvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bbcvl to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5 to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2 to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4 to ip-10-0-131-209.ec2.internal

openshift-ingress

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg to ip-10-0-131-209.ec2.internal

openshift-ingress

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Scheduled

Successfully assigned openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t to ip-10-0-137-114.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-kw95x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kw95x to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22 to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2 to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q to ip-10-0-137-114.ec2.internal

openshift-ingress

router-default-58d678bf84-6skhd

Scheduled

Successfully assigned openshift-ingress/router-default-58d678bf84-6skhd to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8 to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5 to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-spm9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-spm9g to ip-10-0-131-209.ec2.internal

openshift-ingress

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94 to ip-10-0-137-114.ec2.internal

openshift-ingress

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97 to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w to ip-10-0-137-114.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 to ip-10-0-137-114.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zzg9d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh to ip-10-0-131-209.ec2.internal

openshift-ingress

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Scheduled

Successfully assigned openshift-ingress/e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f to ip-10-0-131-209.ec2.internal

openshift-ingress

kube-auth-proxy-85dcd64b9c-rctfp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85dcd64b9c-rctfp to ip-10-0-131-209.ec2.internal

openshift-ingress

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7 to ip-10-0-128-41.ec2.internal

openshift-ingress

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt to ip-10-0-128-41.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw to ip-10-0-137-114.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr to ip-10-0-137-114.ec2.internal
(x6)

openshift-ingress

replicaset-controller

router-default-58d678bf84

FailedCreate

Error creating: pods "router-default-58d678bf84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-58d678bf84 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-58d678bf84

FailedCreate

Error creating: pods "router-default-58d678bf84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-58d678bf84

SuccessfulCreate

Created pod: router-default-58d678bf84-6skhd
(x5)

openshift-ingress

kubelet

router-default-58d678bf84-6skhd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-58d678bf84-6skhd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-58d678bf84-6skhd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-58d678bf84-6skhd

Started

Started container router

openshift-ingress

kubelet

router-default-58d678bf84-6skhd

Created

Created container: router

openshift-ingress

multus

router-default-58d678bf84-6skhd

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-85dcd64b9c-rctfp

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-85dcd64b9c

SuccessfulCreate

Created pod: kube-auth-proxy-85dcd64b9c-tgw8z

openshift-ingress

replicaset-controller

kube-auth-proxy-85dcd64b9c

SuccessfulCreate

Created pod: kube-auth-proxy-85dcd64b9c-rctfp

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-85dcd64b9c from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-rctfp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-85dcd64b9c

FailedCreate

Error creating: pods "kube-auth-proxy-85dcd64b9c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-tgw8z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-85dcd64b9c-tgw8z

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-kw95x

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-kw95x

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-rctfp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-tgw8z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-tgw8z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-tgw8z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.848s (2.848s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-rctfp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.829s (2.829s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-85dcd64b9c-rctfp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.381s (3.381s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6cbcdcfccc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6cbcdcfccc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.105s (3.105s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zzg9d

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zzg9d

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.296s (2.296s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zzg9d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-kw95x

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kw95x

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c747fcbf8

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c747fcbf8-7sjh4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c747fcbf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-spm9g
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bbcvl

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-spm9g

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bbcvl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-bbcvl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spm9g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spm9g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bbcvl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bbcvl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.156s (2.156s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bbcvl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spm9g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spm9g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.442s (2.442s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-7sjh4

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-bb42d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-bb42d5-openshift-default-64b5f4bd48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48

SuccessfulCreate

Created pod: e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

openshift-ingress

gateway_labeler_controller

e2e-inf-a-bb42d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bb42d5

openshift-ingress

multus

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bb42d5: serviceaccount "payload-processing-e2e-inf-a-bb42d5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-bb42d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bb42d5-b7594bcb7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-bb42d5-b7594bcb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bb42d5: serviceaccount "payload-processing-e2e-inf-a-bb42d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bb42d5-b7594bcb7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-bb42d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-bb42d5-b7594bcb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-2bae5943

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2bae5943

openshift-ingress

deployment-controller

e2e-ait-2bae5943-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2bae5943-openshift-default-647c9449b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2bae5943-openshift-default-647c9449b6

SuccessfulCreate

Created pod: e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

openshift-ingress

multus

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2bae5943-69c56f586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2bae5943-69c56f586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2bae5943-69c56f586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2bae5943: serviceaccount "payload-processing-e2e-ait-2bae5943" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2bae5943-68bf6fb749

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2bae5943-68bf6fb749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2bae5943: serviceaccount "payload-processing-e2e-ait-2bae5943" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2bae5943-68bf6fb749

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2bae5943

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2bae5943-68bf6fb749 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2bae5943

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2bae5943-69c56f586 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-44e3af-openshift-default-85fc544bb4

SuccessfulCreate

Created pod: e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

openshift-ingress

gateway_labeler_controller

e2e-autores-44e3af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-44e3af

openshift-ingress

deployment-controller

e2e-autores-44e3af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-44e3af-openshift-default-85fc544bb4 from 0 to 1

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.15s (3.15s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Created

Created container: istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-44e3af-79b545f45d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-44e3af-79b545f45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-44e3af: serviceaccount "payload-processing-e2e-autores-44e3af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-44e3af-79b545f45d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-44e3af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-44e3af-79b545f45d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-44e3af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-44e3af-5bc9b67ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-44e3af-5bc9b67ccf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-44e3af-5bc9b67ccf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-44e3af-5bc9b67ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-44e3af: serviceaccount "payload-processing-e2e-autores-44e3af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4

SuccessfulCreate

Created pod: e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

openshift-ingress

deployment-controller

e2e-inf-b-8f0c5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8f0c5f-openshift-default-779b97dbb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8f0c5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8f0c5f

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8f0c5f: serviceaccount "payload-processing-e2e-inf-b-8f0c5f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8f0c5f: serviceaccount "payload-processing-e2e-inf-b-8f0c5f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8f0c5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8f0c5f-5945cd66b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8f0c5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796

SuccessfulCreate

Created pod: e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

openshift-ingress

deployment-controller

e2e-migrate-59ea8af5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-59ea8af5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-59ea8af5-gw
(x5)

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-59ea8af5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-59ea8af5: serviceaccount "payload-processing-e2e-migrate-59ea8af5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-59ea8af5-68994fc558

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-59ea8af5-68994fc558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-59ea8af5: serviceaccount "payload-processing-e2e-migrate-59ea8af5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-59ea8af5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-59ea8af5-68994fc558 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-59ea8af5-68994fc558

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-59ea8af5-gw-openshift-default-6f98d67796-v9dnp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-fc61ae9e-openshift-default-66f79bd64

SuccessfulCreate

Created pod: e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

openshift-ingress

deployment-controller

e2e-ait-fc61ae9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fc61ae9e-openshift-default-66f79bd64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-fc61ae9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fc61ae9e

openshift-ingress

multus

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fc61ae9e-55b469bb67

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

openshift-ingress

kubelet

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fc61ae9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fc61ae9e-55b469bb67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fc61ae9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fc61ae9e: serviceaccount "payload-processing-e2e-ait-fc61ae9e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fc61ae9e-55b469bb67

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fc61ae9e-55b469bb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fc61ae9e: serviceaccount "payload-processing-e2e-ait-fc61ae9e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-369894e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-369894e2

openshift-ingress

deployment-controller

e2e-derive-369894e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-369894e2-openshift-default-67dcc9655b from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-369894e2-openshift-default-67dcc9655b

SuccessfulCreate

Created pod: e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

openshift-ingress

multus

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-369894e2-5bcc4c99bf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-369894e2-5bcc4c99bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-369894e2: serviceaccount "payload-processing-e2e-derive-369894e2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-369894e2-867756bf8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-369894e2-867756bf8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-369894e2: serviceaccount "payload-processing-e2e-derive-369894e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-369894e2-867756bf8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-369894e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-369894e2-867756bf8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-369894e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-369894e2-5bcc4c99bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-369894e2-5bcc4c99bf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

openshift-ingress

kubelet

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-369894e2-openshift-default-67dcc9655b-q75mt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-44e3af-5bc9b67ccf-gsgck

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-44e3af

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-44e3af: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-44e3af": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-44e3af, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ba4c1d57-57e4-4d8f-92be-b3bb459b6d8f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-44e3af-openshift-default-85fc544bb4-r4dpg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-ba183c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ba183c-openshift-default-7d9fd68d64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-ba183c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ba183c

openshift-ingress

replicaset-controller

e2e-explicit-ba183c-openshift-default-7d9fd68d64

SuccessfulCreate

Created pod: e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

openshift-ingress

multus

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ba183c-6594887946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ba183c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ba183c-657c59d649 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ba183c-657c59d649

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ba183c-657c59d649-lq27q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ba183c-657c59d649

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ba183c-657c59d649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ba183c: serviceaccount "payload-processing-e2e-explicit-ba183c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ba183c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ba183c-6594887946 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ba183c-6594887946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ba183c-6594887946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ba183c: serviceaccount "payload-processing-e2e-explicit-ba183c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-ba183c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-ba183c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-ba183c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-ba183c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7a13de9-edb8-47bf-ba69-4a4b7c018b07, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-ba183c-657c59d649-lq27q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-215950-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-215950-openshift-default-795896b8d8 from 0 to 1

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-215950

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-215950

openshift-ingress

replicaset-controller

e2e-noten-215950-openshift-default-795896b8d8

SuccessfulCreate

Created pod: e2e-noten-215950-openshift-default-795896b8d8-6qm5t

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-ba183c-openshift-default-7d9fd68d64-5tv97

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-mt-7c910967-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7c910967-openshift-default-7fdc59fbc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7c910967-openshift-default-7fdc59fbc6

SuccessfulCreate

Created pod: e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

openshift-ingress

multus

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-7c910967

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7c910967
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c910967-7d6b944d65

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7c910967-7d6b944d65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c910967: serviceaccount "payload-processing-e2e-mt-7c910967" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7c910967

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7c910967-7f955c78f4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c910967-7f955c78f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7c910967-7f955c78f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c910967: serviceaccount "payload-processing-e2e-mt-7c910967" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7c910967

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7c910967-7d6b944d65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c910967-7d6b944d65

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

openshift-ingress

multus

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c910967-7f955c78f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

openshift-ingress

kubelet

e2e-noten-215950-openshift-default-795896b8d8-6qm5t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bb42d5-579764bdfd-tfmjl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-7c910967

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-7c910967: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-7c910967": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-7c910967, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 28931a96-c418-4a13-b1bc-009cb1202caa, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c910967-7d6b944d65-k4fq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-7c910967-openshift-default-7fdc59fbc6-c8pkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8f0c5f-649c5566c4-w7ksg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8f0c5f-5945cd66b7-zg69f

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-586826

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-586826

openshift-ingress

kubelet

e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994

SuccessfulCreate

Created pod: e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

openshift-ingress

deployment-controller

e2e-shared-a-w3-586826-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-586826-openshift-default-7d5dc7f994 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-9e5db6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-9e5db6

openshift-ingress

replicaset-controller

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d

SuccessfulCreate

Created pod: e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

openshift-ingress

deployment-controller

e2e-shared-a-w2-9e5db6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-586826: serviceaccount "payload-processing-e2e-shared-a-w3-586826" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-586826

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-586826-698687fddb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-586826-6ddf847cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-586826-6ddf847cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-586826: serviceaccount "payload-processing-e2e-shared-a-w3-586826" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-586826-6ddf847cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

openshift-ingress

multus

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-586826

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-586826-6ddf847cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-9e5db6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6: serviceaccount "payload-processing-e2e-shared-a-w2-9e5db6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6: serviceaccount "payload-processing-e2e-shared-a-w2-9e5db6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-9e5db6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:33878->10.134.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:33878->10.134.0.51:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-9dcc39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-9dcc39

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd

SuccessfulCreate

Created pod: e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

openshift-ingress

deployment-controller

e2e-shared-b-w3-9dcc39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-54c040

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-54c040

openshift-ingress

multus

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9dcc39: serviceaccount "payload-processing-e2e-shared-b-w3-9dcc39" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-54c040-openshift-default-5f8848f484

SuccessfulCreate

Created pod: e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9dcc39: serviceaccount "payload-processing-e2e-shared-b-w3-9dcc39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-9dcc39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-9dcc39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-9dcc39-8649844f55 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w2-54c040-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-54c040-openshift-default-5f8848f484 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-54c040

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-54c040: serviceaccount "payload-processing-e2e-shared-b-w2-54c040" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-54c040: serviceaccount "payload-processing-e2e-shared-b-w2-54c040" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-54c040

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-e96075f7-openshift-default-6d67d46b64

SuccessfulCreate

Created pod: e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

openshift-ingress

gateway_labeler_controller

e2e-mt-e96075f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e96075f7

openshift-ingress

deployment-controller

e2e-mt-e96075f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e96075f7-openshift-default-6d67d46b64 from 0 to 1

openshift-ingress

multus

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e96075f7-54f694958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e96075f7-7ff67549f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e96075f7-7ff67549f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e96075f7-7ff67549f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e96075f7: serviceaccount "payload-processing-e2e-mt-e96075f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e96075f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e96075f7-7ff67549f7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e96075f7-54f694958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e96075f7-54f694958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e96075f7: serviceaccount "payload-processing-e2e-mt-e96075f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e96075f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e96075f7-54f694958 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-e96075f7-7ff67549f7-4c6fk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e96075f7-openshift-default-6d67d46b64-l86jx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-53471f-openshift-default-55ffd9f55b

SuccessfulCreate

Created pod: e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

openshift-ingress

gateway_labeler_controller

e2e-api-a-53471f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-53471f

openshift-ingress

deployment-controller

e2e-api-a-53471f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-53471f-openshift-default-55ffd9f55b from 0 to 1

openshift-ingress

multus

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-53471f-5689c77947

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-53471f-5689c77947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-53471f: serviceaccount "payload-processing-e2e-api-a-53471f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-53471f-5689c77947

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-53471f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-53471f-5689c77947 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-53471f-754cc8cc86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-53471f-754cc8cc86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-53471f-754cc8cc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-53471f: serviceaccount "payload-processing-e2e-api-a-53471f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-53471f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-53471f-754cc8cc86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Unhealthy

Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": read tcp 10.133.0.2:52766->10.133.0.83:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

ProbeError

Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": read tcp 10.133.0.2:52766->10.133.0.83:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-7ae247-openshift-default-5c8db48c46

SuccessfulCreate

Created pod: e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

openshift-ingress

deployment-controller

e2e-api-b-7ae247-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7ae247-openshift-default-5c8db48c46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-7ae247

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7ae247

openshift-ingress

multus

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7ae247

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7ae247-f7c66dbb9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7ae247: serviceaccount "payload-processing-e2e-api-b-7ae247" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7ae247-f7c66dbb9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7ae247-f7c66dbb9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7ae247-f7c66dbb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7ae247: serviceaccount "payload-processing-e2e-api-b-7ae247" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7ae247

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

openshift-ingress

kubelet

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-53471f-5689c77947-5d2jd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-7ae247

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-7ae247: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-7ae247": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-7ae247, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 558944b0-be07-4aa9-977f-ed0713d7fe1b, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-7ae247-openshift-default-5c8db48c46-nq5kr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-9e5db6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-9e5db6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1dfdb31e-5c0f-4a16-9082-72256dcebf55, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54c040-5f575fdc7d-k4h5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-90366e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-90366e

openshift-ingress

deployment-controller

e2e-ipp-a-90366e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-90366e-openshift-default-67db47f7b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-90366e-openshift-default-67db47f7b8

SuccessfulCreate

Created pod: e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-90366e: serviceaccount "payload-processing-e2e-ipp-a-90366e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-90366e-68cb4b4967

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-90366e-68cb4b4967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-90366e: serviceaccount "payload-processing-e2e-ipp-a-90366e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-90366e-68cb4b4967

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-90366e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-90366e-68cb4b4967 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-90366e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-90366e-8448c57f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Unhealthy

Readiness probe failed: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

ProbeError

Readiness probe error: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-6b9e31-openshift-default-5b9bb844

SuccessfulCreate

Created pod: e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6b9e31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6b9e31

openshift-ingress

deployment-controller

e2e-ipp-b-6b9e31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6b9e31-openshift-default-5b9bb844 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6b9e31-75d99575

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6b9e31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6b9e31: serviceaccount "payload-processing-e2e-ipp-b-6b9e31" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6b9e31-75d99575

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6b9e31-75d99575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6b9e31: serviceaccount "payload-processing-e2e-ipp-b-6b9e31" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6b9e31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6b9e31-75d99575 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-652186-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-652186-openshift-default-6f9649df44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-652186-openshift-default-6f9649df44

SuccessfulCreate

Created pod: e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

openshift-ingress

multus

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-652186

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-652186

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-652186

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-652186-6f8455664c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-652186-6f8455664c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-652186-6f8455664c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-652186: serviceaccount "payload-processing-e2e-ipp-cleanup-652186" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-652186: serviceaccount "payload-processing-e2e-ipp-cleanup-652186" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-652186

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-652186-6f8455664c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-652186-6f8455664c-5s6kh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-652186-openshift-default-6f9649df44-sqqs2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6b9e31-54c6849ccd-72fx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-6b9e31

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-6b9e31: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-6b9e31": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-6b9e31, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3edfd1e7-b8f7-4357-be4a-94e892cf932f, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-586826

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-586826": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 731177cd-5c6b-4fdc-922f-fe7f003c950b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-586826-6ddf847cc-67g4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-586826-openshift-default-7d5dc7f994-hntb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9dcc39-8649844f55-ggz2g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-9dcc39-openshift-default-6d69d9fbdd-5jnf7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503