Time Namespace Component RelatedObject Reason Message

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-8wgqs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf to ip-10-0-135-183.ec2.internal

openshift-ingress

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf to ip-10-0-142-230.ec2.internal

openshift-ingress

kube-auth-proxy-797c7d88fd-snkdh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-797c7d88fd-snkdh to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75 to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4 to ip-10-0-135-16.ec2.internal

openshift-ingress

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk to ip-10-0-135-183.ec2.internal

openshift-ingress

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98 to ip-10-0-135-16.ec2.internal

openshift-ingress

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q to ip-10-0-135-183.ec2.internal

openshift-ingress

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7 to ip-10-0-135-16.ec2.internal

openshift-ingress

kube-auth-proxy-797c7d88fd-gm7jh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd to ip-10-0-142-230.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-88gpc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b to ip-10-0-135-16.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 to ip-10-0-142-230.ec2.internal

openshift-ingress

router-default-6fcb677dbb-2nz2z

Scheduled

Successfully assigned openshift-ingress/router-default-6fcb677dbb-2nz2z to ip-10-0-135-183.ec2.internal

openshift-ingress

router-default-6fcb677dbb-2nz2z

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8 to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2 to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4 to ip-10-0-135-16.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw to ip-10-0-135-183.ec2.internal

openshift-ingress

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-4pv2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw to ip-10-0-142-230.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-l8td8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l8td8 to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8 to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6 to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn to ip-10-0-135-16.ec2.internal

openshift-ingress

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt to ip-10-0-135-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g to ip-10-0-142-230.ec2.internal

openshift-ingress

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-qqpzb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-qqpzb to ip-10-0-135-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv to ip-10-0-142-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc to ip-10-0-142-230.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6fcb677dbb from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-6fcb677dbb

FailedCreate

Error creating: pods "router-default-6fcb677dbb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6fcb677dbb

FailedCreate

Error creating: pods "router-default-6fcb677dbb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-6fcb677dbb

SuccessfulCreate

Created pod: router-default-6fcb677dbb-2nz2z
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-6fcb677dbb-2nz2z

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6fcb677dbb-2nz2z

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6fcb677dbb-2nz2z

Created

Created container: router

openshift-ingress

kubelet

router-default-6fcb677dbb-2nz2z

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6fcb677dbb-2nz2z

AddedInterface

Add eth0 [10.132.0.7/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6fcb677dbb-2nz2z

Started

Started container router
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-797c7d88fd

FailedCreate

Error creating: pods "kube-auth-proxy-797c7d88fd-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-797c7d88fd

SuccessfulCreate

Created pod: kube-auth-proxy-797c7d88fd-gm7jh

openshift-ingress

replicaset-controller

kube-auth-proxy-797c7d88fd

SuccessfulCreate

Created pod: kube-auth-proxy-797c7d88fd-snkdh

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-797c7d88fd from 0 to 2

openshift-ingress

multus

kube-auth-proxy-797c7d88fd-gm7jh

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-gm7jh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-797c7d88fd-snkdh

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-snkdh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-8wgqs

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-8wgqs

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-gm7jh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-snkdh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-gm7jh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.119s (3.119s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-gm7jh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-snkdh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-797c7d88fd-snkdh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.18s (3.18s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 12.072s (12.072s including waiting). Image size: 181126104 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-88gpc

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-88gpc

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-88gpc

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-88gpc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-88gpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-88gpc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-88gpc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.142s (4.142s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl5vgw

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8wgqs

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-8wgqs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-l8td8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-l8td8

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-4pv2g

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-qqpzb

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qqpzb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-qqpzb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4pv2g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-4pv2g

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qqpzb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.467s (1.467s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qqpzb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qqpzb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4pv2g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.367s (2.367s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4pv2g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4pv2g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l8td8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l8td8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l8td8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l8td8

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-l8td8

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-dbe0e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-dbe0e7-openshift-default-694b6fb884 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-dbe0e7-openshift-default-694b6fb884

SuccessfulCreate

Created pod: e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

openshift-ingress

multus

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-dbe0e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-dbe0e7

openshift-ingress

multus

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-dbe0e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-dbe0e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-dbe0e7-d95777455 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dbe0e7-d95777455

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dbe0e7: serviceaccount "payload-processing-e2e-inf-a-dbe0e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dbe0e7-d95777455

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-dbe0e7-d95777455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dbe0e7: serviceaccount "payload-processing-e2e-inf-a-dbe0e7" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-bddd3ec1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bddd3ec1

openshift-ingress

deployment-controller

e2e-ait-bddd3ec1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bddd3ec1-openshift-default-868fcdcc56 from 0 to 1

openshift-ingress

multus

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-bddd3ec1-openshift-default-868fcdcc56

SuccessfulCreate

Created pod: e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

openshift-ingress

replicaset-controller

e2e-autores-5a5ab7-openshift-default-8664dcff6d

SuccessfulCreate

Created pod: e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

openshift-ingress

deployment-controller

e2e-autores-5a5ab7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5a5ab7-openshift-default-8664dcff6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-5a5ab7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5a5ab7

openshift-ingress

GatewayAuthBootstrap

e2e-autores-5a5ab7

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-5a5ab7-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-5a5ab7-authn-ssl" already exists

openshift-ingress

multus

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bddd3ec1: serviceaccount "payload-processing-e2e-ait-bddd3ec1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bddd3ec1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bddd3ec1-dcf597479

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bddd3ec1-dcf597479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bddd3ec1: serviceaccount "payload-processing-e2e-ait-bddd3ec1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bddd3ec1-dcf597479

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bddd3ec1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bddd3ec1-dcf597479 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5a5ab7-57646d9598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5a5ab7-767fc89d4c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5a5ab7-767fc89d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5a5ab7: serviceaccount "payload-processing-e2e-autores-5a5ab7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5a5ab7-57646d9598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5a5ab7-57646d9598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5a5ab7: serviceaccount "payload-processing-e2e-autores-5a5ab7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5a5ab7-767fc89d4c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5a5ab7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5a5ab7-57646d9598 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5a5ab7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5a5ab7-767fc89d4c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:34562->10.132.0.50:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:34562->10.132.0.50:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c6bcf5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c6bcf5

openshift-ingress

replicaset-controller

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd

SuccessfulCreate

Created pod: e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

openshift-ingress

deployment-controller

e2e-inf-b-c6bcf5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd from 0 to 1

openshift-ingress

multus

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c6bcf5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c6bcf5-647449c96f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c6bcf5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c6bcf5-647449c96f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c6bcf5-647449c96f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c6bcf5-647449c96f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c6bcf5: serviceaccount "payload-processing-e2e-inf-b-c6bcf5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c6bcf5: serviceaccount "payload-processing-e2e-inf-b-c6bcf5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-bddd3ec1-openshift-default-868fcdcc56-rbg2g

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd

SuccessfulCreate

Created pod: e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

openshift-ingress

deployment-controller

e2e-migrate-5fdde1a2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-5fdde1a2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5fdde1a2-gw
(x5)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5fdde1a2: serviceaccount "payload-processing-e2e-migrate-5fdde1a2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5fdde1a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5fdde1a2-65c88db94b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5fdde1a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5fdde1a2-65c88db94b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5fdde1a2-65c88db94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5fdde1a2: serviceaccount "payload-processing-e2e-migrate-5fdde1a2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5fdde1a2-65c88db94b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

openshift-ingress

kubelet

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-5fdde1a2-gw-openshift-default-8458b596dd-xn4qt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-8ede8f25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8ede8f25

openshift-ingress

deployment-controller

e2e-ait-8ede8f25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8ede8f25-openshift-default-7cc7947754 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-8ede8f25-openshift-default-7cc7947754

SuccessfulCreate

Created pod: e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.562s (2.562s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ede8f25: serviceaccount "payload-processing-e2e-ait-8ede8f25" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ede8f25-69d98567c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ede8f25-69d98567c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8ede8f25-69d98567c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ede8f25: serviceaccount "payload-processing-e2e-ait-8ede8f25" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8ede8f25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8ede8f25-85f89fc58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8ede8f25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8ede8f25-69d98567c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-d507e5c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d507e5c9

openshift-ingress

kubelet

e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-d507e5c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d507e5c9-openshift-default-6fcc584b88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-d507e5c9-openshift-default-6fcc584b88

SuccessfulCreate

Created pod: e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d507e5c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d507e5c9-b98569698 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d507e5c9-b98569698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d507e5c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d507e5c9-6c5769f777 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d507e5c9-6c5769f777

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d507e5c9-6c5769f777

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d507e5c9-6c5769f777-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d507e5c9: serviceaccount "payload-processing-e2e-derive-d507e5c9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d507e5c9-b98569698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d507e5c9-b98569698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d507e5c9: serviceaccount "payload-processing-e2e-derive-d507e5c9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:53330->10.133.0.43:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:53330->10.133.0.43:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-explicit-c92551

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c92551

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-5a5ab7-openshift-default-8664dcff6d-dcwm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-c92551-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c92551-openshift-default-78cccc897b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c92551-openshift-default-78cccc897b

SuccessfulCreate

Created pod: e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

openshift-ingress

kubelet

payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c92551: serviceaccount "payload-processing-e2e-explicit-c92551" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c92551

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c92551-74b9699877 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c92551

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c92551-74b9699877

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c92551-74b9699877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c92551: serviceaccount "payload-processing-e2e-explicit-c92551" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c92551-74b9699877

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-c92551-74b9699877-fvwdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-c92551-openshift-default-78cccc897b-nts4r

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-4503d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4503d2

openshift-ingress

deployment-controller

e2e-noten-4503d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4503d2-openshift-default-769c747cb from 0 to 1

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-4503d2-openshift-default-769c747cb

SuccessfulCreate

Created pod: e2e-noten-4503d2-openshift-default-769c747cb-5f76k

openshift-ingress

multus

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-5745b581

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5745b581

openshift-ingress

deployment-controller

e2e-mt-5745b581-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5745b581-openshift-default-76846c4d84 from 0 to 1

openshift-ingress

multus

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-5745b581-openshift-default-76846c4d84

SuccessfulCreate

Created pod: e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

openshift-ingress

multus

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5745b581: serviceaccount "payload-processing-e2e-mt-5745b581" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5745b581

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5745b581

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5745b581-7bbfd7b95c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5745b581-7bbfd7b95c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5745b581-7bbfd7b95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5745b581: serviceaccount "payload-processing-e2e-mt-5745b581" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5745b581-7bbfd7b95c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

openshift-ingress

kubelet

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-4503d2-openshift-default-769c747cb-5f76k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dbe0e7-d95777455-wnw98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-5745b581

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-5745b581: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-5745b581": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-5745b581, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1609a569-8a31-43e9-a0f4-e032f4e8e38a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-dbe0e7-openshift-default-694b6fb884-zr98q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6bcf5-647449c96f-jcsh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-c6bcf5-openshift-default-577d9b8cfd-x27jw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8

SuccessfulCreate

Created pod: e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-272c5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-272c5e

openshift-ingress

deployment-controller

e2e-shared-a-w3-272c5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8989e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8989e8

openshift-ingress

deployment-controller

e2e-shared-a-w2-8989e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96

SuccessfulCreate

Created pod: e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

openshift-ingress

multus

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-272c5e: serviceaccount "payload-processing-e2e-shared-a-w3-272c5e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-272c5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-272c5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-272c5e: serviceaccount "payload-processing-e2e-shared-a-w3-272c5e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8989e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8989e8: serviceaccount "payload-processing-e2e-shared-a-w2-8989e8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8989e8: serviceaccount "payload-processing-e2e-shared-a-w2-8989e8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8989e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-117711-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-117711-openshift-default-77fc5586c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-117711-openshift-default-77fc5586c4

SuccessfulCreate

Created pod: e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-117711

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-117711

openshift-ingress

multus

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-117711: serviceaccount "payload-processing-e2e-shared-b-w3-117711" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-117711

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-117711: serviceaccount "payload-processing-e2e-shared-b-w3-117711" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-117711

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-117711-6f65b68bd5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4

SuccessfulCreate

Created pod: e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-6daa53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6daa53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6daa53

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6daa53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6daa53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6daa53-77c66d685f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6daa53: serviceaccount "payload-processing-e2e-shared-b-w2-6daa53" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6daa53: serviceaccount "payload-processing-e2e-shared-b-w2-6daa53" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-307b7f39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-307b7f39-openshift-default-c8cffb556 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-307b7f39-openshift-default-c8cffb556

SuccessfulCreate

Created pod: e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

openshift-ingress

multus

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-307b7f39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-307b7f39

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-307b7f39-767f878777

SuccessfulCreate

Created pod: payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-307b7f39-5b757dd494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

openshift-ingress

deployment-controller

payload-processing-e2e-mt-307b7f39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-307b7f39-767f878777 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-307b7f39-767f878777

FailedCreate

Error creating: pods "payload-processing-e2e-mt-307b7f39-767f878777-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-307b7f39: serviceaccount "payload-processing-e2e-mt-307b7f39" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-307b7f39-5b757dd494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-307b7f39-5b757dd494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-307b7f39: serviceaccount "payload-processing-e2e-mt-307b7f39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-307b7f39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-307b7f39-5b757dd494 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-307b7f39-767f878777-bgv4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-307b7f39-openshift-default-c8cffb556-dlsnf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-f9def1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f9def1-openshift-default-66768d9446 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f9def1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f9def1

openshift-ingress

replicaset-controller

e2e-api-a-f9def1-openshift-default-66768d9446

SuccessfulCreate

Created pod: e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

openshift-ingress

multus

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f9def1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f9def1-5dc85f4c85 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f9def1: serviceaccount "payload-processing-e2e-api-a-f9def1" not found

openshift-ingress

multus

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f9def1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f9def1-56f7cdf686 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f9def1-5dc85f4c85

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f9def1-5dc85f4c85

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f9def1-5dc85f4c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f9def1: serviceaccount "payload-processing-e2e-api-a-f9def1" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-641847

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-641847

openshift-ingress

deployment-controller

e2e-api-b-641847-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-641847-openshift-default-5598ccdfcd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-641847-openshift-default-5598ccdfcd

SuccessfulCreate

Created pod: e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

openshift-ingress

multus

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-641847

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-641847-5fd49b95f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-641847

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-641847-7f998cb67d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-641847-5fd49b95f7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-641847-5fd49b95f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-641847: serviceaccount "payload-processing-e2e-api-b-641847" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-641847-5fd49b95f7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-641847-7f998cb67d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-641847-7f998cb67d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-641847-7f998cb67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-641847: serviceaccount "payload-processing-e2e-api-b-641847" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9def1-5dc85f4c85-qfqj4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-f9def1-openshift-default-66768d9446-7tp57

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-641847

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-641847: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-641847": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-641847, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3e1bbb2d-b840-4694-a8e8-b559b0e49d39, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-641847-5fd49b95f7-pxh75

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-641847-7f998cb67d-4l5cf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8989e8-7fb967dc5f-mqhd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6daa53-77c66d685f-v8jnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-6daa53-openshift-default-d4f886bd4-pjqpk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-b19164-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b19164-openshift-default-5666d77bb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b19164

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b19164

openshift-ingress

replicaset-controller

e2e-ipp-a-b19164-openshift-default-5666d77bb4

SuccessfulCreate

Created pod: e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b19164-7dbcf76459

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b19164

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b19164-78784585f8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b19164-7dbcf76459

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b19164-7dbcf76459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b19164: serviceaccount "payload-processing-e2e-ipp-a-b19164" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b19164

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b19164-7dbcf76459 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b19164-78784585f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b19164-78784585f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b19164: serviceaccount "payload-processing-e2e-ipp-a-b19164" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b19164-78784585f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

openshift-ingress

multus

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-720006-openshift-default-5754749bc8

SuccessfulCreate

Created pod: e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

openshift-ingress

multus

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-720006

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-720006

openshift-ingress

deployment-controller

e2e-ipp-b-720006-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-720006-openshift-default-5754749bc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-720006

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-720006-5d4f946f89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-720006

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-720006-f77d45ffd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-720006: serviceaccount "payload-processing-e2e-ipp-b-720006" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-720006-5d4f946f89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-720006-5d4f946f89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-720006-5d4f946f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-720006: serviceaccount "payload-processing-e2e-ipp-b-720006" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b8e0f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b8e0f0

openshift-ingress

multus

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b8e0f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b8e0f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b8e0f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0: serviceaccount "payload-processing-e2e-ipp-cleanup-b8e0f0" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0: serviceaccount "payload-processing-e2e-ipp-cleanup-b8e0f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b8e0f0-7fdc66588b-bpp9b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b19164-78784585f8-nz6k4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-720006-f77d45ffd-5chhl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-720006-5d4f946f89-zvm2x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-720006-openshift-default-5754749bc8-twkxt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-272c5e-585d4b86c8-f8cvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-272c5e-6bc7b57547-zwktw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-117711-openshift-default-77fc5586c4-4xz8f

Killing

Stopping container istio-proxy