Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq to ip-10-0-131-230.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-sxkck

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck to ip-10-0-131-230.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wpdr4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wpdr4 to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml to ip-10-0-131-230.ec2.internal

openshift-ingress

kube-auth-proxy-7d544f58d6-7sgdg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d544f58d6-7sgdg to ip-10-0-133-190.ec2.internal

openshift-ingress

kube-auth-proxy-7d544f58d6-r84vc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d544f58d6-r84vc to ip-10-0-141-66.ec2.internal

openshift-ingress

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Scheduled

Successfully assigned openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8 to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-g5bbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-g5bbx to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67 to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-612453-767cf94c94-q8djt to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq to ip-10-0-131-230.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lqjvs to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-6bpz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-6bpz9 to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk to ip-10-0-131-230.ec2.internal

openshift-ingress

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 to ip-10-0-131-230.ec2.internal

openshift-ingress

router-default-68555bcf85-tdf9s

Scheduled

Successfully assigned openshift-ingress/router-default-68555bcf85-tdf9s to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5 to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76 to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds to ip-10-0-141-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz to ip-10-0-131-230.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz to ip-10-0-131-230.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd to ip-10-0-141-66.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-68555bcf85 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-68555bcf85

FailedCreate

Error creating: pods "router-default-68555bcf85-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-68555bcf85

FailedCreate

Error creating: pods "router-default-68555bcf85-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-68555bcf85

SuccessfulCreate

Created pod: router-default-68555bcf85-tdf9s
(x5)

openshift-ingress

kubelet

router-default-68555bcf85-tdf9s

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-68555bcf85-tdf9s

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-68555bcf85-tdf9s

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-68555bcf85-tdf9s

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-68555bcf85-tdf9s

Created

Created container: router

openshift-ingress

kubelet

router-default-68555bcf85-tdf9s

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-7d544f58d6

SuccessfulCreate

Created pod: kube-auth-proxy-7d544f58d6-7sgdg

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-7sgdg

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-r84vc

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7d544f58d6

SuccessfulCreate

Created pod: kube-auth-proxy-7d544f58d6-r84vc
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d544f58d6

FailedCreate

Error creating: pods "kube-auth-proxy-7d544f58d6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d544f58d6 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-r84vc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d544f58d6-7sgdg

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d544f58d6-r84vc

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-7sgdg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wpdr4

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wpdr4

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-r84vc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.485s (2.485s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-r84vc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-r84vc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.61s (4.61s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-7sgdg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.587s (5.587s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-7sgdg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d544f58d6-7sgdg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-sxkck

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-sxkck

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.857s (2.857s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cldhpm

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.506s (3.506s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-sxkck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wpdr4

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wpdr4

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-lqjvs

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.015s (3.015s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-6bpz9

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6bpz9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-6bpz9

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-g5bbx

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g5bbx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-g5bbx

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6bpz9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.321s (2.321s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g5bbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.368s (2.368s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6bpz9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-6bpz9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g5bbx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g5bbx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lqjvs

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-94ce66b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-94ce66b8

openshift-ingress

deployment-controller

e2e-ait-94ce66b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-94ce66b8-openshift-default-cd9cbcf46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-94ce66b8-openshift-default-cd9cbcf46

SuccessfulCreate

Created pod: e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

openshift-ingress

multus

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-94ce66b8: serviceaccount "payload-processing-e2e-ait-94ce66b8" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-94ce66b8-69648df5cd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-94ce66b8-69648df5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-94ce66b8: serviceaccount "payload-processing-e2e-ait-94ce66b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-94ce66b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-94ce66b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-94ce66b8-69648df5cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-94ce66b8-69648df5cd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

openshift-ingress

kubelet

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.951s (2.951s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

ProbeError

Readiness probe error: Get "http://10.132.0.24:15021/healthz/ready": read tcp 10.132.0.2:55396->10.132.0.24:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Unhealthy

Readiness probe failed: Get "http://10.132.0.24:15021/healthz/ready": read tcp 10.132.0.2:55396->10.132.0.24:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Unhealthy

Startup probe failed: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

ProbeError

Startup probe error: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-94ce66b8-69648df5cd-tggwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-610dc5ab-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-610dc5ab-gw

openshift-ingress

deployment-controller

e2e-migrate-610dc5ab-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-610dc5ab-gw-openshift-default-6877d98784 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784

SuccessfulCreate

Created pod: e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

openshift-ingress

multus

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-610dc5ab: serviceaccount "payload-processing-e2e-migrate-610dc5ab" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-610dc5ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-610dc5ab-776c55f949

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-610dc5ab-776c55f949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-610dc5ab: serviceaccount "payload-processing-e2e-migrate-610dc5ab" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-610dc5ab-776c55f949

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-610dc5ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-610dc5ab-776c55f949 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Unhealthy

Readiness probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

ProbeError

Readiness probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

ProbeError

Startup probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Unhealthy

Startup probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-610dc5ab

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-610dc5ab": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5337b757-b2fd-4cde-b5de-3acc4ebf97ba, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-696b6b1c-openshift-default-7f5477bb

SuccessfulCreate

Created pod: e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

openshift-ingress

deployment-controller

e2e-ait-696b6b1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-696b6b1c-openshift-default-7f5477bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-696b6b1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-696b6b1c

openshift-ingress

multus

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-696b6b1c-7bb8587fd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-696b6b1c-7bb8587fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-696b6b1c: serviceaccount "payload-processing-e2e-ait-696b6b1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-696b6b1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

openshift-ingress

kubelet

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-696b6b1c: serviceaccount "payload-processing-e2e-ait-696b6b1c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-696b6b1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-696b6b1c-7bb8587fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-696b6b1c-7bb8587fd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": read tcp 10.132.0.2:56768->10.132.0.32:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": read tcp 10.132.0.2:56768->10.132.0.32:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-696b6b1c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-696b6b1c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb0e1fd0-6a4b-41d6-8b15-f60dfb554cf1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-3cfa77ca-openshift-default-5d9958476

SuccessfulCreate

Created pod: e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

openshift-ingress

deployment-controller

e2e-derive-3cfa77ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3cfa77ca-openshift-default-5d9958476 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-3cfa77ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3cfa77ca

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3cfa77ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3cfa77ca-566c7bf586 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

openshift-ingress

multus

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3cfa77ca-566c7bf586

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3cfa77ca-566c7bf586

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3cfa77ca-566c7bf586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3cfa77ca: serviceaccount "payload-processing-e2e-derive-3cfa77ca" not found

openshift-ingress

multus

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3cfa77ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb from 0 to 1

openshift-ingress

kubelet

e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3cfa77ca: serviceaccount "payload-processing-e2e-derive-3cfa77ca" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Unhealthy

Readiness probe failed: dial tcp 10.132.0.38:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": read tcp 10.132.0.2:39740->10.132.0.36:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": read tcp 10.132.0.2:39740->10.132.0.36:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-6f2e14d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6f2e14d7-openshift-default-5766696dc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6f2e14d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6f2e14d7

openshift-ingress

replicaset-controller

e2e-mt-6f2e14d7-openshift-default-5766696dc6

SuccessfulCreate

Created pod: e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6f2e14d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6f2e14d7: serviceaccount "payload-processing-e2e-mt-6f2e14d7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6f2e14d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6f2e14d7-7b7ccf786b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

openshift-ingress

kubelet

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6f2e14d7: serviceaccount "payload-processing-e2e-mt-6f2e14d7" not found
(x2)

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Unhealthy

Readiness probe failed: dial tcp 10.132.0.42:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-6f2e14d7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-6f2e14d7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 793e8435-5bd4-4648-a446-a092f2ff1198, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb

Unhealthy

Readiness probe failed: dial tcp 10.132.0.43:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-2dc45aaa-openshift-default-7779bb56dd

SuccessfulCreate

Created pod: e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

openshift-ingress

multus

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-2dc45aaa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2dc45aaa

openshift-ingress

deployment-controller

e2e-mt-2dc45aaa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2dc45aaa-openshift-default-7779bb56dd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2dc45aaa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2dc45aaa-574f77888d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2dc45aaa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2dc45aaa-858b85985d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2dc45aaa-858b85985d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

openshift-ingress

multus

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2dc45aaa: serviceaccount "payload-processing-e2e-mt-2dc45aaa" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2dc45aaa-858b85985d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2dc45aaa-858b85985d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2dc45aaa: serviceaccount "payload-processing-e2e-mt-2dc45aaa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": read tcp 10.132.0.2:44534->10.132.0.44:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": read tcp 10.132.0.2:44534->10.132.0.44:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-inf-a-306d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-306d65-openshift-default-5cd666dc66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-306d65-openshift-default-5cd666dc66

SuccessfulCreate

Created pod: e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

openshift-ingress

gateway_labeler_controller

e2e-inf-a-306d65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-306d65

openshift-ingress

multus

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-306d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-306d65-575757bbcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-306d65: serviceaccount "payload-processing-e2e-inf-a-306d65" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-306d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-306d65-575757bbcd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-306d65-575757bbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-306d65: serviceaccount "payload-processing-e2e-inf-a-306d65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-306d65-575757bbcd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

openshift-ingress

kubelet

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": read tcp 10.132.0.2:50864->10.132.0.49:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": read tcp 10.132.0.2:50864->10.132.0.49:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-612453

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-612453

openshift-ingress

deployment-controller

e2e-inf-b-612453-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-612453-openshift-default-696d5c78f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-612453-openshift-default-696d5c78f4

SuccessfulCreate

Created pod: e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

openshift-ingress

multus

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-612453

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-612453-767cf94c94 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-612453-767cf94c94

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-612453-767cf94c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-612453: serviceaccount "payload-processing-e2e-inf-b-612453" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-612453

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-612453-54c54f4f6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-612453-54c54f4f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-612453-54c54f4f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-612453-54c54f4f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-612453: serviceaccount "payload-processing-e2e-inf-b-612453" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-612453-767cf94c94

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:41448->10.132.0.53:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:41448->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-306d65

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-306d65: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-306d65": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-306d65, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e570fe2a-dd54-4638-8dc6-db606c4b6f1d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-612453-767cf94c94-q8djt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-d0f1b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d0f1b8

openshift-ingress

replicaset-controller

e2e-api-a-d0f1b8-openshift-default-6c7d789b6

SuccessfulCreate

Created pod: e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

openshift-ingress

multus

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-d0f1b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d0f1b8-openshift-default-6c7d789b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d0f1b8-77c457db94

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d0f1b8-77c457db94

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d0f1b8-77c457db94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d0f1b8: serviceaccount "payload-processing-e2e-api-a-d0f1b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d0f1b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d0f1b8-77c457db94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d0f1b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d0f1b8: serviceaccount "payload-processing-e2e-api-a-d0f1b8" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": read tcp 10.132.0.2:35506->10.132.0.58:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": read tcp 10.132.0.2:35506->10.132.0.58:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-cddb75-openshift-default-6f4c8c56dd

SuccessfulCreate

Created pod: e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

openshift-ingress

deployment-controller

e2e-api-b-cddb75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cddb75-openshift-default-6f4c8c56dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-cddb75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cddb75

openshift-ingress

multus

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cddb75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cddb75-79f4c86d44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cddb75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cddb75-79cb485ff6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cddb75-79f4c86d44

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cddb75-79f4c86d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cddb75: serviceaccount "payload-processing-e2e-api-b-cddb75" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cddb75-79f4c86d44

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cddb75: serviceaccount "payload-processing-e2e-api-b-cddb75" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

openshift-ingress

multus

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cddb75-79cb485ff6-98chh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-0abb48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-0abb48-openshift-default-5f945bb56d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-0abb48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-0abb48

openshift-ingress

multus

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-0abb48-openshift-default-5f945bb56d

SuccessfulCreate

Created pod: e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-0abb48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-0abb48-c8f7d9d46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-0abb48-c8f7d9d46

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-0abb48-c8f7d9d46

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-0abb48-c8f7d9d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-0abb48: serviceaccount "payload-processing-e2e-shared-a-0abb48" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-0abb48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-0abb48: serviceaccount "payload-processing-e2e-shared-a-0abb48" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-27430b-openshift-default-fbb5f548d

SuccessfulCreate

Created pod: e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

openshift-ingress

multus

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-27430b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-27430b-openshift-default-fbb5f548d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-27430b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-27430b

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-27430b-656494ff6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-27430b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-27430b-98c6c7f8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-27430b-98c6c7f8b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-27430b-98c6c7f8b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-27430b-98c6c7f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-27430b: serviceaccount "payload-processing-e2e-shared-b-27430b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-27430b-656494ff6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-27430b-656494ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-27430b: serviceaccount "payload-processing-e2e-shared-b-27430b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-27430b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-27430b-656494ff6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:58178->10.132.0.69:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:58178->10.132.0.69:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-b9d569-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4

SuccessfulCreate

Created pod: e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b9d569

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b9d569

openshift-ingress

multus

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b9d569

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b9d569-6d67dfcc6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b9d569

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b9d569: serviceaccount "payload-processing-e2e-ipp-a-b9d569" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b9d569: serviceaccount "payload-processing-e2e-ipp-a-b9d569" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-150c68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-150c68-openshift-default-74c6fbb978 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-150c68-openshift-default-74c6fbb978

SuccessfulCreate

Created pod: e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-150c68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-150c68

openshift-ingress

multus

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-150c68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-150c68-654b964bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-150c68-654b964bf8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-150c68-654b964bf8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-150c68-654b964bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-150c68: serviceaccount "payload-processing-e2e-ipp-b-150c68" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-150c68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-150c68: serviceaccount "payload-processing-e2e-ipp-b-150c68" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.571s (1.571s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-82acc2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-82acc2

openshift-ingress

deployment-controller

e2e-ipp-cleanup-82acc2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

openshift-ingress

multus

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2: serviceaccount "payload-processing-e2e-ipp-cleanup-82acc2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-82acc2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2: serviceaccount "payload-processing-e2e-ipp-cleanup-82acc2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-82acc2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-82acc2-5bdb84f8d4-vrxds

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b9d569-6d67dfcc6-mzrlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b9d569-5f84788fbd-fbsmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-150c68-654b964bf8-74bpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-150c68-openshift-default-74c6fbb978-6pb8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-27430b-98c6c7f8b-fp78b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503