Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49 to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2 to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2 to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc to ip-10-0-141-227.ec2.internal

openshift-ingress

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q to ip-10-0-143-175.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-42jct

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-42jct to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-526b4727-openshift-default-75854694d4-xx8bd to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f33ec8-84f48486c7-bx462 to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p to ip-10-0-129-76.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-7hf78

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7hf78 to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8 to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6 to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945 to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9 to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58 to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-cgt48

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-cgt48 to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr to ip-10-0-143-175.ec2.internal

openshift-ingress

kube-auth-proxy-77b7bc76bc-v8gdn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77b7bc76bc-v8gdn to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9 to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj to ip-10-0-129-76.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf to ip-10-0-141-227.ec2.internal

openshift-ingress

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6 to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26 to ip-10-0-129-76.ec2.internal

openshift-ingress

router-default-c5cb56bb8-jq29f

Scheduled

Successfully assigned openshift-ingress/router-default-c5cb56bb8-jq29f to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ghksm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ghksm to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f33ec8-openshift-default-684b546598-5tzpg to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c3abd1-openshift-default-585df76644-lzcvk to ip-10-0-143-175.ec2.internal

openshift-ingress

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fcd453-openshift-default-6758677554-78r2r to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5 to ip-10-0-143-175.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7 to ip-10-0-129-76.ec2.internal

openshift-ingress

kube-auth-proxy-77b7bc76bc-mrxgc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77b7bc76bc-mrxgc to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p to ip-10-0-129-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx to ip-10-0-129-76.ec2.internal

openshift-ingress

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx to ip-10-0-141-227.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww to ip-10-0-129-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nj4wg to ip-10-0-141-227.ec2.internal

openshift-ingress

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g to ip-10-0-143-175.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-c5cb56bb8 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-c5cb56bb8

FailedCreate

Error creating: pods "router-default-c5cb56bb8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-c5cb56bb8

FailedCreate

Error creating: pods "router-default-c5cb56bb8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-c5cb56bb8

SuccessfulCreate

Created pod: router-default-c5cb56bb8-jq29f
(x6)

openshift-ingress

kubelet

router-default-c5cb56bb8-jq29f

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-c5cb56bb8-jq29f

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-c5cb56bb8-jq29f

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-c5cb56bb8-jq29f

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-c5cb56bb8-jq29f

Created

Created container: router

openshift-ingress

kubelet

router-default-c5cb56bb8-jq29f

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-mrxgc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-77b7bc76bc-v8gdn

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-77b7bc76bc-mrxgc

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-v8gdn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-77b7bc76bc

FailedCreate

Error creating: pods "kube-auth-proxy-77b7bc76bc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-77b7bc76bc

SuccessfulCreate

Created pod: kube-auth-proxy-77b7bc76bc-v8gdn

openshift-ingress

replicaset-controller

kube-auth-proxy-77b7bc76bc

SuccessfulCreate

Created pod: kube-auth-proxy-77b7bc76bc-mrxgc

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-77b7bc76bc from 0 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-7hf78

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7hf78

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-7hf78

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-mrxgc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-v8gdn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-mrxgc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.867s (2.867s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-mrxgc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-v8gdn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.78s (2.78s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-77b7bc76bc-v8gdn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7hf78

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.31s (3.31s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7hf78

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7hf78

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.487s (2.487s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c7gqlt

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-42jct

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-42jct

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-42jct

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-42jct

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.386s (5.386s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-42jct

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-42jct

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-7hf78

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7hf78

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-nj4wg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.498s (3.498s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ghksm

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ghksm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-cgt48

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-cgt48

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-cgt48

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ghksm

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-cgt48

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.375s (1.375s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ghksm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.401s (1.401s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ghksm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ghksm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-cgt48

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-cgt48

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nj4wg

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-f56165

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f56165

openshift-ingress

replicaset-controller

e2e-worker-w4-f56165-openshift-default-6f8477bdc4

SuccessfulCreate

Created pod: e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

openshift-ingress

multus

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-f56165-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-f56165-openshift-default-6f8477bdc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-2735c5-openshift-default-6fbdd776db

SuccessfulCreate

Created pod: e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

openshift-ingress

multus

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-ee0096-openshift-default-f8d8dbc48

SuccessfulCreate

Created pod: e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

openshift-ingress

deployment-controller

e2e-inf-a-ee0096-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ee0096-openshift-default-f8d8dbc48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ee0096

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ee0096

openshift-ingress

deployment-controller

e2e-worker-w0-2735c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2735c5-openshift-default-6fbdd776db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-2735c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-2735c5

openshift-ingress

multus

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2735c5: serviceaccount "payload-processing-e2e-worker-w0-2735c5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-2735c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-2735c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2735c5: serviceaccount "payload-processing-e2e-worker-w0-2735c5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

openshift-ingress

multus

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f56165: serviceaccount "payload-processing-e2e-worker-w4-f56165" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-f56165

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-f56165-66fdc7d49c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f56165-66fdc7d49c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f56165-66fdc7d49c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-f56165-66fdc7d49c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f56165: serviceaccount "payload-processing-e2e-worker-w4-f56165" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-f56165

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ee0096-f7b6cb579

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ee0096: serviceaccount "payload-processing-e2e-inf-a-ee0096" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ee0096

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ee0096

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ee0096-f7b6cb579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ee0096-f7b6cb579

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ee0096-f7b6cb579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ee0096: serviceaccount "payload-processing-e2e-inf-a-ee0096" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

Started

Started container payload-processing

openshift-ingress

multus

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-f33ec8-openshift-default-684b546598

SuccessfulCreate

Created pod: e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

openshift-ingress

deployment-controller

e2e-autores-f33ec8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f33ec8-openshift-default-684b546598 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-f33ec8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f33ec8

openshift-ingress

replicaset-controller

e2e-ait-e8faa2dc-openshift-default-b54449cbd

SuccessfulCreate

Created pod: e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

openshift-ingress

deployment-controller

e2e-ait-e8faa2dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e8faa2dc-openshift-default-b54449cbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e8faa2dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e8faa2dc

openshift-ingress

multus

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e8faa2dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e8faa2dc-d7675fcc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8faa2dc: serviceaccount "payload-processing-e2e-ait-e8faa2dc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e8faa2dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8faa2dc-d7675fcc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e8faa2dc-d7675fcc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8faa2dc: serviceaccount "payload-processing-e2e-ait-e8faa2dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8faa2dc-d7675fcc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

openshift-ingress

kubelet

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f33ec8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f33ec8-768d8888bb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f33ec8-84f48486c7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f33ec8-84f48486c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f33ec8: serviceaccount "payload-processing-e2e-autores-f33ec8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f33ec8-768d8888bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f33ec8-768d8888bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f33ec8: serviceaccount "payload-processing-e2e-autores-f33ec8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f33ec8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f33ec8-84f48486c7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-fcd453-openshift-default-6758677554

SuccessfulCreate

Created pod: e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f33ec8-768d8888bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

openshift-ingress

multus

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fcd453

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fcd453

openshift-ingress

deployment-controller

e2e-inf-b-fcd453-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fcd453-openshift-default-6758677554 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f33ec8-84f48486c7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fcd453-d9f4b669c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fcd453-d9f4b669c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fcd453: serviceaccount "payload-processing-e2e-inf-b-fcd453" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fcd453-d9f4b669c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fcd453: serviceaccount "payload-processing-e2e-inf-b-fcd453" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fcd453

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fcd453

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fcd453-d9f4b669c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8faa2dc-68b7574b66-9fv6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e8faa2dc-openshift-default-b54449cbd-vp75z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-e8faa2dc-d7675fcc5-st86j

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8

SuccessfulCreate

Created pod: e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

openshift-ingress

deployment-controller

e2e-migrate-4e9b0a83-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-4e9b0a83-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4e9b0a83-gw

openshift-ingress

multus

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4e9b0a83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4e9b0a83-598d55f6bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4e9b0a83: serviceaccount "payload-processing-e2e-migrate-4e9b0a83" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4e9b0a83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4e9b0a83: serviceaccount "payload-processing-e2e-migrate-4e9b0a83" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-4e9b0a83-598d55f6bb-pksj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4e9b0a83-64c5cc8c7d-qxdgl

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-b63bda62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b63bda62-openshift-default-5c7857676d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b63bda62-openshift-default-5c7857676d

SuccessfulCreate

Created pod: e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

openshift-ingress

kubelet

e2e-migrate-4e9b0a83-gw-openshift-default-6dc8ff6db8-4mm8t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-b63bda62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b63bda62

openshift-ingress

multus

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b63bda62: serviceaccount "payload-processing-e2e-ait-b63bda62" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b63bda62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b63bda62-6bdc67c94c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b63bda62-6bdc67c94c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b63bda62-6bdc67c94c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b63bda62-6bdc67c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b63bda62: serviceaccount "payload-processing-e2e-ait-b63bda62" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b63bda62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b63bda62-6bdc67c94c-sntn7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b63bda62-f9c5bcdf8-4lb5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b63bda62-openshift-default-5c7857676d-ln4js

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-67d9aa69-openshift-default-7dc94f957b

SuccessfulCreate

Created pod: e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

openshift-ingress

deployment-controller

e2e-derive-67d9aa69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-67d9aa69-openshift-default-7dc94f957b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-67d9aa69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-67d9aa69

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-67d9aa69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-67d9aa69-6575b9d498 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-67d9aa69: serviceaccount "payload-processing-e2e-derive-67d9aa69" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-67d9aa69-56454fd585

FailedCreate

Error creating: pods "payload-processing-e2e-derive-67d9aa69-56454fd585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-67d9aa69: serviceaccount "payload-processing-e2e-derive-67d9aa69" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-67d9aa69-56454fd585

SuccessfulCreate

Created pod: payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

openshift-ingress

deployment-controller

payload-processing-e2e-derive-67d9aa69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-67d9aa69-56454fd585 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f33ec8-768d8888bb-bbrbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-f33ec8-84f48486c7-bx462

Unhealthy

Readiness probe failed: dial tcp 10.134.0.40:9004: i/o timeout
(x5)

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-67d9aa69-56454fd585-jddkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67d9aa69-6575b9d498-vsktq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-67d9aa69-openshift-default-7dc94f957b-kpstx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-c258f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c258f1-openshift-default-576f7b8cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-c258f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c258f1

openshift-ingress

replicaset-controller

e2e-explicit-c258f1-openshift-default-576f7b8cb8

SuccessfulCreate

Created pod: e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

openshift-ingress

multus

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-f33ec8-openshift-default-684b546598-5tzpg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c258f1: serviceaccount "payload-processing-e2e-explicit-c258f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c258f1-54bb895db5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c258f1-54bb895db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c258f1: serviceaccount "payload-processing-e2e-explicit-c258f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c258f1-54bb895db5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c258f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c258f1-54bb895db5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c258f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c258f1-764cdcbb66 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-526b4727

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-526b4727

openshift-ingress

deployment-controller

e2e-mt-526b4727-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-526b4727-openshift-default-75854694d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-526b4727-openshift-default-75854694d4

SuccessfulCreate

Created pod: e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

openshift-ingress

multus

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-526b4727

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-526b4727-7ffb78b4df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-526b4727

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-526b4727-766f88884b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-526b4727-766f88884b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-526b4727-766f88884b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-526b4727: serviceaccount "payload-processing-e2e-mt-526b4727" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-526b4727-7ffb78b4df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-526b4727-7ffb78b4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-526b4727: serviceaccount "payload-processing-e2e-mt-526b4727" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-526b4727-766f88884b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-526b4727-7ffb78b4df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-526b4727-766f88884b-d6cwp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-526b4727-7ffb78b4df-h5sqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-526b4727-openshift-default-75854694d4-xx8bd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d

SuccessfulCreate

Created pod: e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3a4c9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3a4c9f

openshift-ingress

deployment-controller

e2e-shared-a-w2-3a4c9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-c258f1-54bb895db5-95sv2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-c258f1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-c258f1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-c258f1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-c258f1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d23e7fb9-8886-4119-9fd5-fabac9876eed, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c258f1-764cdcbb66-t568c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3a4c9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3a4c9f: serviceaccount "payload-processing-e2e-shared-a-w2-3a4c9f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3a4c9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3a4c9f: serviceaccount "payload-processing-e2e-shared-a-w2-3a4c9f" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-c3abd1-openshift-default-585df76644

SuccessfulCreate

Created pod: e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-c3abd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c3abd1-openshift-default-585df76644 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-c3abd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c3abd1

openshift-ingress

kubelet

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-c258f1-openshift-default-576f7b8cb8-wqpvk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4

SuccessfulCreate

Created pod: e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-27b9d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-27b9d8

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:59372->10.134.0.53:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w2-27b9d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:59372->10.134.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-27b9d8: serviceaccount "payload-processing-e2e-shared-b-w2-27b9d8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-27b9d8: serviceaccount "payload-processing-e2e-shared-b-w2-27b9d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-27b9d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-27b9d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-b21d1ff2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b21d1ff2

openshift-ingress

deployment-controller

e2e-mt-b21d1ff2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d

SuccessfulCreate

Created pod: e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

openshift-ingress

multus

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b21d1ff2: serviceaccount "payload-processing-e2e-mt-b21d1ff2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b21d1ff2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b21d1ff2-64d6fcc577 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b21d1ff2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b21d1ff2-64d6fcc577

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b21d1ff2-64d6fcc577-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b21d1ff2: serviceaccount "payload-processing-e2e-mt-b21d1ff2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b21d1ff2-64d6fcc577

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

openshift-ingress

multus

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-c3abd1-openshift-default-585df76644-lzcvk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee0096-f7b6cb579-grrpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee0096-79986cd4c8-vhprg

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee0096-openshift-default-f8d8dbc48-bhxqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fcd453-d9f4b669c-gv2nx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fcd453-86b7fb78c4-jn945

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-fcd453-openshift-default-6758677554-78r2r

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-04464b-openshift-default-cb67865d8

SuccessfulCreate

Created pod: e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

openshift-ingress

deployment-controller

e2e-shared-a-w3-04464b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-04464b-openshift-default-cb67865d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-04464b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-04464b

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-04464b: serviceaccount "payload-processing-e2e-shared-a-w3-04464b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-04464b-6db6d65595

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-04464b-6db6d65595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-04464b: serviceaccount "payload-processing-e2e-shared-a-w3-04464b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-04464b-6db6d65595

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-04464b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-04464b-6db6d65595 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-04464b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd

SuccessfulCreate

Created pod: e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

openshift-ingress

deployment-controller

e2e-shared-b-w3-e3a482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e3a482-openshift-default-85598c95bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e3a482

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e3a482

openshift-ingress

multus

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e3a482

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e3a482-64b846b799 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e3a482-64b846b799

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e3a482-64b846b799

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e3a482-64b846b799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e3a482: serviceaccount "payload-processing-e2e-shared-b-w3-e3a482" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e3a482

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e3a482: serviceaccount "payload-processing-e2e-shared-b-w3-e3a482" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-b21d1ff2-64d6fcc577-lhlqn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b21d1ff2-d74bbc754-mhtsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b21d1ff2-openshift-default-5d6cc9f98d-pqsl6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4ef86b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4ef86b

openshift-ingress

deployment-controller

e2e-api-a-4ef86b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4ef86b-openshift-default-5d9d47d5b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6

SuccessfulCreate

Created pod: e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

openshift-ingress

multus

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4ef86b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4ef86b-6f9844996f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4ef86b: serviceaccount "payload-processing-e2e-api-a-4ef86b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4ef86b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4ef86b-6f9844996f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4ef86b-6f9844996f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4ef86b: serviceaccount "payload-processing-e2e-api-a-4ef86b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4ef86b-6f9844996f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

openshift-ingress

multus

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2735c5-fdc8c9bcc-q6jfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2735c5-5c8d5d4bd6-nmdww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-2735c5-openshift-default-6fbdd776db-xk48q

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-1755f7-openshift-default-84d75f88dd

SuccessfulCreate

Created pod: e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

openshift-ingress

deployment-controller

e2e-api-b-1755f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1755f7-openshift-default-84d75f88dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-1755f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1755f7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1755f7-6cfd449466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1755f7-6cfd449466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1755f7: serviceaccount "payload-processing-e2e-api-b-1755f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1755f7-6cfd449466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1755f7-785bcdd875

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1755f7-785bcdd875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1755f7: serviceaccount "payload-processing-e2e-api-b-1755f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1755f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1755f7-785bcdd875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1755f7-785bcdd875

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1755f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1755f7-6cfd449466 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-4ef86b-6f9844996f-7w6vc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4ef86b-6684f6f8cd-wwvrq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4ef86b-openshift-default-5d9d47d5b6-59v5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-1755f7-785bcdd875-87qk8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1755f7-6cfd449466-c5mgj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-1755f7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-1755f7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-1755f7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-1755f7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 25c87e4a-d12e-4a32-8784-7dcae11b7b89, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-1755f7-openshift-default-84d75f88dd-rzb5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3a4c9f-5645d74986-mprzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3a4c9f-88fbf8fb5-bhnxk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-3a4c9f-openshift-default-56d5bf5d-xhp8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-27b9d8-f8c7f74c8-gqbfd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-27b9d8-6dcfcf888c-dqkb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-27b9d8-openshift-default-7dccc89bb4-xs7lg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f56165-7b58fd8f9d-68rdr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f56165-66fdc7d49c-wvq26

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-f56165-openshift-default-6f8477bdc4-6vshc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b179ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b179ed

openshift-ingress

deployment-controller

e2e-ipp-a-b179ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b179ed-openshift-default-85fcb5565d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b179ed-openshift-default-85fcb5565d

SuccessfulCreate

Created pod: e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

openshift-ingress

multus

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b179ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b179ed: serviceaccount "payload-processing-e2e-ipp-a-b179ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b179ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b179ed-68c45db669 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b179ed-68c45db669

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b179ed-68c45db669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b179ed: serviceaccount "payload-processing-e2e-ipp-a-b179ed" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b179ed-68c45db669

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": read tcp 10.133.0.2:46748->10.133.0.90:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": read tcp 10.133.0.2:46748->10.133.0.90:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-5d58bd-openshift-default-95bc45568

SuccessfulCreate

Created pod: e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

openshift-ingress

deployment-controller

e2e-ipp-b-5d58bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5d58bd-openshift-default-95bc45568 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5d58bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5d58bd

openshift-ingress

multus

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d58bd: serviceaccount "payload-processing-e2e-ipp-b-5d58bd" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d58bd: serviceaccount "payload-processing-e2e-ipp-b-5d58bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5d58bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5d58bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78

SuccessfulCreate

Created pod: e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-0fd0de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-0fd0de

openshift-ingress

deployment-controller

e2e-ipp-cleanup-0fd0de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-0fd0de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0fd0de: serviceaccount "payload-processing-e2e-ipp-cleanup-0fd0de" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-0fd0de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0fd0de: serviceaccount "payload-processing-e2e-ipp-cleanup-0fd0de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0fd0de-5cc77969bf-xtw49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0fd0de-68c5d96874-wzzfm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-0fd0de-openshift-default-5c447c4d78-xwtmc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b179ed-68c45db669-zm5wb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b179ed-7cf54b5ff4-7k9x9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b179ed-openshift-default-85fcb5565d-v4q6t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d58bd-76cb76697d-dmj58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d58bd-78f47bdcc9-z4f7q

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-5d58bd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-5d58bd: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-5d58bd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-5d58bd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 62fb17b1-bbea-48c6-9237-69d77927fa01, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-5d58bd-openshift-default-95bc45568-rl5tz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-04464b-6db6d65595-s9wc5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-04464b-57979cc8c4-bdmjz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-04464b-openshift-default-cb67865d8-924nr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e3a482-64b846b799-g46dw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e3a482-6d5877857d-zwz5p

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-e3a482

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e3a482: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-e3a482": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e3a482, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9a4c5ef2-bbc3-4b9e-bb07-150105689e95, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-e3a482-openshift-default-85598c95bd-kbwg6

Killing

Stopping container istio-proxy