Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8 to ip-10-0-135-148.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4 to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd to ip-10-0-135-148.ec2.internal

openshift-ingress

kube-auth-proxy-d78dff5cc-l48jh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-d78dff5cc-l48jh to ip-10-0-130-52.ec2.internal

openshift-ingress

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-74da27-554776985f-4qnc9 to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8 to ip-10-0-135-148.ec2.internal

openshift-ingress

kube-auth-proxy-d78dff5cc-c254b

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-d78dff5cc-c254b to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-05557e-7756dbc97-snsgb to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7q576

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7q576 to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5 to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p to ip-10-0-135-148.ec2.internal

openshift-ingress

router-default-65c7764bf8-c5p5m

Scheduled

Successfully assigned openshift-ingress/router-default-65c7764bf8-c5p5m to ip-10-0-133-42.ec2.internal

openshift-ingress

router-default-65c7764bf8-c5p5m

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97 to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-xx5vp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-xx5vp to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4 to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p to ip-10-0-135-148.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-x2h9l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-x2h9l to ip-10-0-130-52.ec2.internal

openshift-ingress

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c to ip-10-0-133-42.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-qvvww

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qvvww to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt to ip-10-0-133-42.ec2.internal

openshift-ingress

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp to ip-10-0-135-148.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-4jdr6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-4jdr6 to ip-10-0-133-42.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj to ip-10-0-133-42.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-65c7764bf8 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-65c7764bf8

FailedCreate

Error creating: pods "router-default-65c7764bf8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-65c7764bf8

FailedCreate

Error creating: pods "router-default-65c7764bf8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-65c7764bf8

SuccessfulCreate

Created pod: router-default-65c7764bf8-c5p5m
(x6)

openshift-ingress

kubelet

router-default-65c7764bf8-c5p5m

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-65c7764bf8-c5p5m

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-65c7764bf8-c5p5m

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-65c7764bf8-c5p5m

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-65c7764bf8-c5p5m

Started

Started container router

openshift-ingress

kubelet

router-default-65c7764bf8-c5p5m

Created

Created container: router
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-d78dff5cc

FailedCreate

Error creating: pods "kube-auth-proxy-d78dff5cc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-d78dff5cc

SuccessfulCreate

Created pod: kube-auth-proxy-d78dff5cc-l48jh

openshift-ingress

replicaset-controller

kube-auth-proxy-d78dff5cc

SuccessfulCreate

Created pod: kube-auth-proxy-d78dff5cc-c254b

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-d78dff5cc from 0 to 2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-c254b

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-x2h9l

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-l48jh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-d78dff5cc-c254b

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-d78dff5cc-l48jh

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-x2h9l

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-c254b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.87s (2.87s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-c254b

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-c254b

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.668s (3.668s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-l48jh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-l48jh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-d78dff5cc-l48jh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.822s (4.822s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-4jdr6

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4jdr6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-4jdr6

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4jdr6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.374s (3.374s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.396s (3.396s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4jdr6

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-djrfw

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4jdr6

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-x2h9l

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-x2h9l

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-qvvww

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-qvvww

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-7q576

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-xx5vp

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xx5vp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-xx5vp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7q576

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7q576

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xx5vp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7q576

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.39s (1.39s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7q576

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xx5vp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.326s (1.326s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7q576

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xx5vp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qvvww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qvvww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qvvww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qvvww

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qvvww

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1af1db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1af1db

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-56e305

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-56e305

openshift-ingress

deployment-controller

e2e-inf-a-1af1db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1af1db-openshift-default-7989c75bb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-1af1db-openshift-default-7989c75bb8

SuccessfulCreate

Created pod: e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

openshift-ingress

multus

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-360e43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-360e43-openshift-default-8644c46c86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-360e43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-360e43

openshift-ingress

replicaset-controller

e2e-worker-w0-360e43-openshift-default-8644c46c86

SuccessfulCreate

Created pod: e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

openshift-ingress

replicaset-controller

e2e-worker-w4-56e305-openshift-default-5d6b566cd8

SuccessfulCreate

Created pod: e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

openshift-ingress

deployment-controller

e2e-worker-w4-56e305-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-56e305-openshift-default-5d6b566cd8 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1af1db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1af1db-6c4f959d59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1af1db-6c4f959d59

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1af1db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1af1db: serviceaccount "payload-processing-e2e-inf-a-1af1db" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1af1db-6c4f959d59

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1af1db-6c4f959d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1af1db: serviceaccount "payload-processing-e2e-inf-a-1af1db" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-360e43: serviceaccount "payload-processing-e2e-worker-w0-360e43" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-360e43-785576c97c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-360e43-785576c97c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-360e43: serviceaccount "payload-processing-e2e-worker-w0-360e43" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-360e43-785576c97c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-360e43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-360e43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-360e43-785576c97c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-56e305: serviceaccount "payload-processing-e2e-worker-w4-56e305" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

openshift-ingress

multus

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-56e305

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-56e305

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-56e305: serviceaccount "payload-processing-e2e-worker-w4-56e305" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-3ba8d384

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3ba8d384

openshift-ingress

deployment-controller

e2e-ait-3ba8d384-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3ba8d384-openshift-default-85857658f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3ba8d384-openshift-default-85857658f4

SuccessfulCreate

Created pod: e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

openshift-ingress

gateway_labeler_controller

e2e-autores-5416b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5416b7

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-autores-5416b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5416b7-openshift-default-78d59dd6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-5416b7-openshift-default-78d59dd6d

SuccessfulCreate

Created pod: e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

openshift-ingress

multus

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.648s (2.648s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5416b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5416b7-6585d467bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5416b7-7db9bd998c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5416b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5416b7-7db9bd998c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5416b7-7db9bd998c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5416b7-7db9bd998c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5416b7: serviceaccount "payload-processing-e2e-autores-5416b7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5416b7-6585d467bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5416b7-6585d467bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5416b7: serviceaccount "payload-processing-e2e-autores-5416b7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5416b7-6585d467bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3ba8d384: serviceaccount "payload-processing-e2e-ait-3ba8d384" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3ba8d384-7774f9cfcc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3ba8d384-7774f9cfcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3ba8d384: serviceaccount "payload-processing-e2e-ait-3ba8d384" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3ba8d384-7774f9cfcc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3ba8d384

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3ba8d384-7774f9cfcc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3ba8d384

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-a2d9c4-openshift-default-9b5885c58

SuccessfulCreate

Created pod: e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

openshift-ingress

deployment-controller

e2e-inf-b-a2d9c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a2d9c4-openshift-default-9b5885c58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a2d9c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a2d9c4

openshift-ingress

multus

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a2d9c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a2d9c4-58896b776f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a2d9c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a2d9c4-58896b776f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a2d9c4: serviceaccount "payload-processing-e2e-inf-b-a2d9c4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a2d9c4-58896b776f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a2d9c4-58896b776f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a2d9c4: serviceaccount "payload-processing-e2e-inf-b-a2d9c4" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-3ba8d384-7774f9cfcc-pk7d4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3ba8d384-5c7c48bd4b-274g6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-3ba8d384-openshift-default-85857658f4-xd9b7

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-migrate-ee52fdef-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-ee52fdef-gw

openshift-ingress

multus

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896

SuccessfulCreate

Created pod: e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

openshift-ingress

deployment-controller

e2e-migrate-ee52fdef-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-ee52fdef-gw-openshift-default-fcb497896 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-ee52fdef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-ee52fdef-54ffbcf598 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-ee52fdef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ee52fdef-54ffbcf598

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-ee52fdef-54ffbcf598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ee52fdef: serviceaccount "payload-processing-e2e-migrate-ee52fdef" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ee52fdef-54ffbcf598

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ee52fdef: serviceaccount "payload-processing-e2e-migrate-ee52fdef" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-ee52fdef

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-ee52fdef: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-ee52fdef": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-ee52fdef, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cef36c20-6977-4c70-b9d3-ddb9b6487804, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-ee52fdef-54ffbcf598-p555w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ee52fdef-74dcfc8c6b-cgnmx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-ee52fdef-gw-openshift-default-fcb497896-5nkvl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-8316f91a-openshift-default-6c96656c98

SuccessfulCreate

Created pod: e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

openshift-ingress

deployment-controller

e2e-ait-8316f91a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8316f91a-openshift-default-6c96656c98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8316f91a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8316f91a

openshift-ingress

multus

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8316f91a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8316f91a-7bdd795cd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8316f91a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8316f91a-7bdd795cd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8316f91a-7bdd795cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8316f91a: serviceaccount "payload-processing-e2e-ait-8316f91a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8316f91a-7bdd795cd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8316f91a: serviceaccount "payload-processing-e2e-ait-8316f91a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-8316f91a-7bdd795cd9-qdtzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8316f91a-7b88d4f5d-stkdd

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-8ce29e8a-openshift-default-577bbbb59b

SuccessfulCreate

Created pod: e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

openshift-ingress

kubelet

e2e-ait-8316f91a-openshift-default-6c96656c98-9crcc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-8ce29e8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8ce29e8a-openshift-default-577bbbb59b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-8ce29e8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8ce29e8a

openshift-ingress

multus

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8ce29e8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8ce29e8a-6db86685 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8ce29e8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8ce29e8a: serviceaccount "payload-processing-e2e-derive-8ce29e8a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8ce29e8a-6db86685

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8ce29e8a-6db86685

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8ce29e8a-6db86685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8ce29e8a: serviceaccount "payload-processing-e2e-derive-8ce29e8a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-8ce29e8a-6db86685-qvdvn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8ce29e8a-7d48d64b8b-5xn5p

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-8ce29e8a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-8ce29e8a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-8ce29e8a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-8ce29e8a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 959458bd-8bc1-450d-a553-34b46fe7f4dd, UID in object meta:

openshift-ingress

kubelet

e2e-derive-8ce29e8a-openshift-default-577bbbb59b-mtft9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5416b7-6585d467bb-x2fdw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5416b7-7db9bd998c-wzgsr

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-4a3a26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4a3a26

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-4a3a26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4a3a26-openshift-default-65f5b98664 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-4a3a26-openshift-default-65f5b98664

SuccessfulCreate

Created pod: e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-5416b7-openshift-default-78d59dd6d-kfm9n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4a3a26: serviceaccount "payload-processing-e2e-explicit-4a3a26" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4a3a26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4a3a26-5898f649f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4a3a26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4a3a26-656c86f47c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4a3a26-656c86f47c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4a3a26-656c86f47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4a3a26: serviceaccount "payload-processing-e2e-explicit-4a3a26" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4a3a26-656c86f47c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8
(x2)

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-e2d4753a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e2d4753a-openshift-default-5564f5548d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-e2d4753a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e2d4753a

openshift-ingress

replicaset-controller

e2e-mt-e2d4753a-openshift-default-5564f5548d

SuccessfulCreate

Created pod: e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

openshift-ingress

multus

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e2d4753a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e2d4753a-7dff4bf945

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e2d4753a-7dff4bf945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e2d4753a: serviceaccount "payload-processing-e2e-mt-e2d4753a" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e2d4753a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e2d4753a-7dff4bf945 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e2d4753a: serviceaccount "payload-processing-e2e-mt-e2d4753a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e2d4753a-7dff4bf945

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4a3a26-5898f649f8-x6pgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4a3a26-656c86f47c-t7pr8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e2d4753a-7dff4bf945-qngzq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e2d4753a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e2d4753a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e2d4753a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e2d4753a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22cd5d11-681f-48ae-98b7-5120f709cd99, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2d4753a-785f7bbf74-55lcr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e2d4753a-openshift-default-5564f5548d-7mdcv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-850f22-openshift-default-5656cdb768

SuccessfulCreate

Created pod: e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-850f22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-850f22

openshift-ingress

multus

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-850f22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-850f22-openshift-default-5656cdb768 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-850f22-8686d6f775

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-850f22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-850f22: serviceaccount "payload-processing-e2e-shared-a-w2-850f22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-850f22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-850f22-8686d6f775 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-850f22-8686d6f775

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-850f22-8686d6f775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-850f22: serviceaccount "payload-processing-e2e-shared-a-w2-850f22" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-4a3a26-openshift-default-65f5b98664-b7sn8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-87ba8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-87ba8b

openshift-ingress

replicaset-controller

e2e-noten-87ba8b-openshift-default-c84d485c6

SuccessfulCreate

Created pod: e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

openshift-ingress

deployment-controller

e2e-noten-87ba8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-87ba8b-openshift-default-c84d485c6 from 0 to 1

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-8c1d2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d

SuccessfulCreate

Created pod: e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-8c1d2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-8c1d2a
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-8c1d2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-8c1d2a: serviceaccount "payload-processing-e2e-shared-b-w2-8c1d2a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-8c1d2a: serviceaccount "payload-processing-e2e-shared-b-w2-8c1d2a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-8c1d2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-8c1d2a-856857697c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-459b305b-openshift-default-644dcff8d

SuccessfulCreate

Created pod: e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

openshift-ingress

deployment-controller

e2e-mt-459b305b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-459b305b-openshift-default-644dcff8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-459b305b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-459b305b

openshift-ingress

multus

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-459b305b-5499445cf7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-459b305b-79655478bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

openshift-ingress

multus

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-459b305b-79655478bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-459b305b-79655478bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-459b305b: serviceaccount "payload-processing-e2e-mt-459b305b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-459b305b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-459b305b-79655478bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-459b305b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-459b305b-5499445cf7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-459b305b-5499445cf7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-459b305b-5499445cf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-459b305b: serviceaccount "payload-processing-e2e-mt-459b305b" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-noten-87ba8b-openshift-default-c84d485c6-kzggh

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1af1db-56cd65c7f8-s4thl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1af1db-6c4f959d59-hwpcp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-1af1db-openshift-default-7989c75bb8-p7z8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2d9c4-7bbd5698c4-gd9bq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2d9c4-58896b776f-b46wv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-a2d9c4-openshift-default-9b5885c58-zk7lt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ce3ab0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ce3ab0

openshift-ingress

deployment-controller

e2e-shared-a-w3-ce3ab0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88

SuccessfulCreate

Created pod: e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

openshift-ingress

multus

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ce3ab0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0: serviceaccount "payload-processing-e2e-shared-a-w3-ce3ab0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ce3ab0: serviceaccount "payload-processing-e2e-shared-a-w3-ce3ab0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ce3ab0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ce3ab0-8656474995 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e7a648

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e7a648

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d

SuccessfulCreate

Created pod: e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-w3-e7a648-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e7a648

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648: serviceaccount "payload-processing-e2e-shared-b-w3-e7a648" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e7a648: serviceaccount "payload-processing-e2e-shared-b-w3-e7a648" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e7a648

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-459b305b-5499445cf7-jg2hl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-459b305b-79655478bb-tzj9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-459b305b-openshift-default-644dcff8d-c4xgx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-05557e-openshift-default-7487957cf8

SuccessfulCreate

Created pod: e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

openshift-ingress

deployment-controller

e2e-api-a-05557e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-05557e-openshift-default-7487957cf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-05557e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-05557e

openshift-ingress

multus

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-05557e-58c65c7f86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-05557e-58c65c7f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-05557e: serviceaccount "payload-processing-e2e-api-a-05557e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-05557e-58c65c7f86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-05557e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-05557e-58c65c7f86 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-05557e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-05557e-7756dbc97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-05557e-7756dbc97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-05557e-7756dbc97-snsgb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-05557e-7756dbc97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-05557e-7756dbc97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-05557e: serviceaccount "payload-processing-e2e-api-a-05557e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-b-74da27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-74da27-openshift-default-5d88774b9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-74da27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-74da27

openshift-ingress

multus

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-74da27-openshift-default-5d88774b9b

SuccessfulCreate

Created pod: e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-74da27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-74da27-6f6648769d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-74da27-6f6648769d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-74da27-6f6648769d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-74da27-6f6648769d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-74da27: serviceaccount "payload-processing-e2e-api-b-74da27" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-74da27-554776985f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-74da27-554776985f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-74da27: serviceaccount "payload-processing-e2e-api-b-74da27" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-74da27-554776985f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-74da27-554776985f-4qnc9

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-74da27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-74da27-554776985f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-05557e-58c65c7f86-8f8fk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-05557e-7756dbc97-snsgb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-05557e-openshift-default-7487957cf8-w9v7b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-74da27-554776985f-4qnc9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-74da27-6f6648769d-bdl6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-74da27-openshift-default-5d88774b9b-8tcfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-850f22-cc956d8b-z4nmb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-850f22-8686d6f775-f75gg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-850f22-openshift-default-5656cdb768-z854q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8c1d2a-856857697c-stjlb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8c1d2a-779f98dd6b-sncfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-8c1d2a-openshift-default-69b55b795d-5r8qn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-360e43-785576c97c-jv62p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-360e43-56bdfb8d6b-tnxcz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-360e43-openshift-default-8644c46c86-wxjbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-56e305-5b7dfc4dc5-zmptj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-56e305-585db8f6f4-hzg8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-56e305-openshift-default-5d6b566cd8-c5rpt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-0886df-openshift-default-b5ffc8f8

SuccessfulCreate

Created pod: e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0886df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0886df

openshift-ingress

deployment-controller

e2e-ipp-a-0886df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0886df-openshift-default-b5ffc8f8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0886df-79d59cf49

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0886df-79d59cf49

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0886df-79d59cf49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0886df: serviceaccount "payload-processing-e2e-ipp-a-0886df" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0886df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0886df-79d59cf49 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0886df: serviceaccount "payload-processing-e2e-ipp-a-0886df" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0886df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-1297a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1297a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1297a3

openshift-ingress

replicaset-controller

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6

SuccessfulCreate

Created pod: e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

openshift-ingress

multus

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1297a3: serviceaccount "payload-processing-e2e-ipp-b-1297a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1297a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1297a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1297a3-6d666f8bb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1297a3: serviceaccount "payload-processing-e2e-ipp-b-1297a3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3596d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3596d6

openshift-ingress

multus

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3596d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3596d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3596d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3596d6: serviceaccount "payload-processing-e2e-ipp-cleanup-3596d6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3596d6: serviceaccount "payload-processing-e2e-ipp-cleanup-3596d6" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3596d6-8659bb4594-w5zlt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3596d6-5f449cb5cc-2z97p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-3596d6-openshift-default-59fccf7c8b-mmp97

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0886df-794cb57d7d-gk879

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0886df-79d59cf49-wjnng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-0886df-openshift-default-b5ffc8f8-4cpdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1297a3-6d666f8bb9-s6hsz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1297a3-5d89f4cd-72jdl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-1297a3-openshift-default-5d86fcf6d6-gh4lg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce3ab0-8656474995-6pvnd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce3ab0-548bdc5654-czgs4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-ce3ab0-openshift-default-858dbc5b88-t8lh5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e7a648-6579dfb5db-tg87k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e7a648-667f5f4dd7-9g9x4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-e7a648

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e7a648: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-e7a648": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e7a648, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9c1385c-e599-4f05-a593-6dafdf01dbd9, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-e7a648-openshift-default-b95db9f4d-rpckb

Killing

Stopping container istio-proxy