Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5 to ip-10-0-142-57.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cgpct

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgpct to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9 to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74 to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99 to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9 to ip-10-0-142-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-5trhr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5trhr to ip-10-0-139-144.ec2.internal

openshift-ingress

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76 to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-8128f3-7b47db56fc-5425f to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s to ip-10-0-139-144.ec2.internal

openshift-ingress

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69 to ip-10-0-139-144.ec2.internal

openshift-ingress

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2 to ip-10-0-139-144.ec2.internal

openshift-ingress

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-spp4h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-spp4h to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-875220-openshift-default-8455794656-lnfxp to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x to ip-10-0-139-144.ec2.internal

openshift-ingress

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc to ip-10-0-142-57.ec2.internal

openshift-ingress

router-default-8667f66c84-kv9d7

Scheduled

Successfully assigned openshift-ingress/router-default-8667f66c84-kv9d7 to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7 to ip-10-0-142-57.ec2.internal

openshift-ingress

kube-auth-proxy-6b984b98c7-r7tgg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b984b98c7-r7tgg to ip-10-0-142-57.ec2.internal

openshift-ingress

kube-auth-proxy-6b984b98c7-nfxsj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b984b98c7-nfxsj to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f to ip-10-0-131-202.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-c7wh7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c7wh7 to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n to ip-10-0-142-57.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-dmnts

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-dmnts to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd to ip-10-0-139-144.ec2.internal

openshift-ingress

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89 to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6 to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql to ip-10-0-131-202.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r to ip-10-0-142-57.ec2.internal

openshift-ingress

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

Scheduled

Successfully assigned openshift-ingress/e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw to ip-10-0-142-57.ec2.internal

openshift-ingress

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc to ip-10-0-131-202.ec2.internal

openshift-ingress

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt to ip-10-0-131-202.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8667f66c84 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-8667f66c84

FailedCreate

Error creating: pods "router-default-8667f66c84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-8667f66c84

FailedCreate

Error creating: pods "router-default-8667f66c84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8667f66c84

SuccessfulCreate

Created pod: router-default-8667f66c84-kv9d7
(x5)

openshift-ingress

kubelet

router-default-8667f66c84-kv9d7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-8667f66c84-kv9d7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-8667f66c84-kv9d7

Started

Started container router

openshift-ingress

multus

router-default-8667f66c84-kv9d7

AddedInterface

Add eth0 [10.133.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8667f66c84-kv9d7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-8667f66c84-kv9d7

Created

Created container: router

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-r7tgg

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-6b984b98c7

FailedCreate

Error creating: pods "kube-auth-proxy-6b984b98c7-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6b984b98c7 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-nfxsj

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6b984b98c7

SuccessfulCreate

Created pod: kube-auth-proxy-6b984b98c7-r7tgg

openshift-ingress

replicaset-controller

kube-auth-proxy-6b984b98c7

SuccessfulCreate

Created pod: kube-auth-proxy-6b984b98c7-nfxsj

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-r7tgg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-nfxsj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6b984b98c7-nfxsj

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6b984b98c7-r7tgg

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-c7wh7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-c7wh7

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-nfxsj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.71s (2.71s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-r7tgg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-r7tgg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.677s (2.677s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-r7tgg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-nfxsj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b984b98c7-nfxsj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.239s (3.239s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cgpct

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cgpct

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8whhg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.554s (2.554s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.371s (2.371s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

Started

Started container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cgpct

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-c7wh7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c7wh7

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-5trhr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-5trhr

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-dmnts
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-spp4h

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-dmnts

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-dmnts

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spp4h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-spp4h

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spp4h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-dmnts

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-dmnts

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.313s (1.313s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-dmnts

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spp4h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.347s (1.347s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-spp4h

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5trhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5trhr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5trhr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5trhr

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5trhr

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-cc0e26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-cc0e26

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-3182b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-3182b5

openshift-ingress

deployment-controller

e2e-inf-a-4b78e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4b78e2-openshift-default-7b7664c598 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4b78e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4b78e2

openshift-ingress

replicaset-controller

e2e-inf-a-4b78e2-openshift-default-7b7664c598

SuccessfulCreate

Created pod: e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

openshift-ingress

multus

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-cc0e26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb

SuccessfulCreate

Created pod: e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

openshift-ingress

replicaset-controller

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8

SuccessfulCreate

Created pod: e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

openshift-ingress

multus

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-3182b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.667s (2.667s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3182b5-b54fdf565

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-3182b5-b54fdf565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3182b5: serviceaccount "payload-processing-e2e-worker-w4-3182b5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3182b5-b54fdf565

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-3182b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-3182b5-b54fdf565 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3182b5: serviceaccount "payload-processing-e2e-worker-w4-3182b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-3182b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4b78e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4b78e2-866cff5565 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4b78e2-866cff5565

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4b78e2-866cff5565

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4b78e2-866cff5565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4b78e2: serviceaccount "payload-processing-e2e-inf-a-4b78e2" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4b78e2: serviceaccount "payload-processing-e2e-inf-a-4b78e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4b78e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc0e26: serviceaccount "payload-processing-e2e-worker-w0-cc0e26" not found

openshift-ingress

replicaset-controller

e2e-autores-8128f3-openshift-default-6dff9b8bb6

SuccessfulCreate

Created pod: e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

openshift-ingress

deployment-controller

e2e-autores-8128f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-8128f3-openshift-default-6dff9b8bb6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc0e26-66bc56769c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-cc0e26-66bc56769c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc0e26: serviceaccount "payload-processing-e2e-worker-w0-cc0e26" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc0e26-66bc56769c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-cc0e26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-cc0e26-66bc56769c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-8128f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-8128f3

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-cc0e26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594 from 0 to 1

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-bd4c1118

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bd4c1118

openshift-ingress

deployment-controller

e2e-ait-bd4c1118-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bd4c1118-openshift-default-565f6989b4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-bd4c1118-openshift-default-565f6989b4

SuccessfulCreate

Created pod: e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.81s (2.81s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bd4c1118

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bd4c1118-ccb7895dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd4c1118: serviceaccount "payload-processing-e2e-ait-bd4c1118" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bd4c1118

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd4c1118-ccb7895dc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bd4c1118-ccb7895dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd4c1118: serviceaccount "payload-processing-e2e-ait-bd4c1118" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd4c1118-ccb7895dc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.568s (2.568s including waiting). Image size: 166453408 bytes.

openshift-ingress

replicaset-controller

e2e-inf-b-c85316-openshift-default-57bfb64984

SuccessfulCreate

Created pod: e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-8128f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-8128f3-54b8dd594 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-8128f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-8128f3-7b47db56fc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8128f3-7b47db56fc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-8128f3-7b47db56fc-5425f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8128f3-7b47db56fc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-8128f3-7b47db56fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8128f3: serviceaccount "payload-processing-e2e-autores-8128f3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8128f3-54b8dd594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c85316

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c85316

openshift-ingress

deployment-controller

e2e-inf-b-c85316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c85316-openshift-default-57bfb64984 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8128f3-54b8dd594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-8128f3-54b8dd594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8128f3: serviceaccount "payload-processing-e2e-autores-8128f3" not found

openshift-ingress

multus

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c85316-7c94d857f9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c85316-7c94d857f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c85316: serviceaccount "payload-processing-e2e-inf-b-c85316" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c85316-8466b65b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c85316-8466b65b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c85316: serviceaccount "payload-processing-e2e-inf-b-c85316" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c85316-8466b65b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c85316

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c85316-7c94d857f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c85316-7c94d857f9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c85316

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c85316-8466b65b58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4c1118-67dd68b8fd-jvhxm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-bd4c1118-openshift-default-dockercfg-95q5f); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4c1118-ccb7895dc-h69gf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-bd4c1118-openshift-default-565f6989b4-xjv76

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-0c7c7a36-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-0c7c7a36-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-0c7c7a36-gw-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64

SuccessfulCreate

Created pod: e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

openshift-ingress

deployment-controller

e2e-migrate-0c7c7a36-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0c7c7a36-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0c7c7a36-gw

openshift-ingress

multus

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0c7c7a36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd
(x2)

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0c7c7a36: serviceaccount "payload-processing-e2e-migrate-0c7c7a36" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx
(x2)

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0c7c7a36: serviceaccount "payload-processing-e2e-migrate-0c7c7a36" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0c7c7a36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0c7c7a36-58fbdf4458 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-0c7c7a36-58fbdf4458-5r4vd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0c7c7a36-5cff67b878-vx2hx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-0c7c7a36-gw-openshift-default-7895b4fb64-7zwlt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-0c7c7a36

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-0c7c7a36: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-0c7c7a36": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-0c7c7a36, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a9a0218e-b8ae-4ff3-9553-e0a12931d55c, UID in object meta:

openshift-ingress

deployment-controller

e2e-ait-32a87fd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-32a87fd8-openshift-default-7f58d48f6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-32a87fd8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-32a87fd8

openshift-ingress

replicaset-controller

e2e-ait-32a87fd8-openshift-default-7f58d48f6b

SuccessfulCreate

Created pod: e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

openshift-ingress

multus

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-32a87fd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-32a87fd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-32a87fd8-698458f6d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-32a87fd8-698458f6d5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-32a87fd8-698458f6d5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-32a87fd8-698458f6d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-32a87fd8: serviceaccount "payload-processing-e2e-ait-32a87fd8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-32a87fd8: serviceaccount "payload-processing-e2e-ait-32a87fd8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-32a87fd8-c4dff8d98-b45kr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-32a87fd8-698458f6d5-m9r89

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-39e34e62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-39e34e62-openshift-default-7b6d986896 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-39e34e62-openshift-default-7b6d986896

SuccessfulCreate

Created pod: e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

openshift-ingress

gateway_labeler_controller

e2e-derive-39e34e62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-39e34e62

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-32a87fd8-openshift-default-7f58d48f6b-p76dc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-39e34e62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-39e34e62-6dc5c7bfb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-39e34e62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-39e34e62: serviceaccount "payload-processing-e2e-derive-39e34e62" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-39e34e62: serviceaccount "payload-processing-e2e-derive-39e34e62" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

openshift-ingress

multus

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8128f3-54b8dd594-bkzbf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8128f3-7b47db56fc-5425f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-875220-openshift-default-8455794656

SuccessfulCreate

Created pod: e2e-explicit-875220-openshift-default-8455794656-lnfxp

openshift-ingress

deployment-controller

e2e-explicit-875220-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-875220-openshift-default-8455794656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-875220

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-875220

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-8128f3-openshift-default-6dff9b8bb6-j2btf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-explicit-875220-openshift-default-8455794656-lnfxp

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-875220

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-875220-98bf89f4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-875220

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-875220-c87bbc54f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-875220-98bf89f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-875220-98bf89f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-875220: serviceaccount "payload-processing-e2e-explicit-875220" not found
(x4)

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-39e34e62-5f95b9dff4-r2kck

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-875220-c87bbc54f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-875220-c87bbc54f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-875220-c87bbc54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-875220: serviceaccount "payload-processing-e2e-explicit-875220" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-39e34e62-6dc5c7bfb5-t9vpc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-39e34e62

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-39e34e62: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-39e34e62": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-39e34e62, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b5e3c9ae-29cc-4c44-805d-80de770d1be8, UID in object meta:

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-875220-98bf89f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

openshift-ingress

kubelet

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-39e34e62-openshift-default-7b6d986896-6sxkw

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-aec2317b-openshift-default-7cf96449d4

SuccessfulCreate

Created pod: e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

openshift-ingress

deployment-controller

e2e-mt-aec2317b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-aec2317b-openshift-default-7cf96449d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-aec2317b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-aec2317b

openshift-ingress

multus

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-875220-98bf89f4b-v62s6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-875220-c87bbc54f-gv2gt

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-aec2317b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

openshift-ingress

kubelet

e2e-explicit-875220-openshift-default-8455794656-lnfxp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-aec2317b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-aec2317b-659fc99cfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aec2317b-659fc99cfc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aec2317b-659fc99cfc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-aec2317b-659fc99cfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aec2317b: serviceaccount "payload-processing-e2e-mt-aec2317b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aec2317b: serviceaccount "payload-processing-e2e-mt-aec2317b" not found

openshift-ingress

multus

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-2d8e5f-openshift-default-c858df59b

SuccessfulCreate

Created pod: e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

openshift-ingress

deployment-controller

e2e-noten-2d8e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-2d8e5f-openshift-default-c858df59b from 0 to 1

openshift-ingress

multus

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-2d8e5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-2d8e5f

openshift-ingress

kubelet

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec2317b-6bb6767ddb-tx4xc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aec2317b-659fc99cfc-2flhh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-aec2317b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-aec2317b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-aec2317b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-aec2317b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d3d5755c-5b21-41f1-9fb5-e0c215ae3851, UID in object meta:

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-aec2317b-openshift-default-7cf96449d4-hlfpx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2b3fb3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2b3fb3

openshift-ingress

deployment-controller

e2e-shared-a-w2-2b3fb3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58

SuccessfulCreate

Created pod: e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

openshift-ingress

multus

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-2d8e5f-openshift-default-c858df59b-ntwvl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b3fb3: serviceaccount "payload-processing-e2e-shared-a-w2-2b3fb3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2b3fb3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b3fb3: serviceaccount "payload-processing-e2e-shared-a-w2-2b3fb3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2b3fb3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-b-w2-836c16-openshift-default-758797f458

SuccessfulCreate

Created pod: e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

openshift-ingress

deployment-controller

e2e-shared-b-w2-836c16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-836c16-openshift-default-758797f458 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-836c16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-836c16

openshift-ingress

multus

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-836c16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-836c16-67555b54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-836c16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-836c16: serviceaccount "payload-processing-e2e-shared-b-w2-836c16" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-836c16: serviceaccount "payload-processing-e2e-shared-b-w2-836c16" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b78e2-7b5f77b54b-ptc6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b78e2-866cff5565-lbqlk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": read tcp 10.133.0.2:58100->10.133.0.64:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": read tcp 10.133.0.2:58100->10.133.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-957d1190

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-957d1190

openshift-ingress

deployment-controller

e2e-mt-957d1190-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-957d1190-openshift-default-f6c658df6 from 0 to 1

openshift-ingress

multus

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-957d1190-openshift-default-f6c658df6

SuccessfulCreate

Created pod: e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

openshift-ingress

multus

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-957d1190: serviceaccount "payload-processing-e2e-mt-957d1190" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-957d1190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-957d1190-59d5f7df6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-957d1190-6bc8475fdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-957d1190-6bc8475fdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-957d1190: serviceaccount "payload-processing-e2e-mt-957d1190" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-957d1190-6bc8475fdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

openshift-ingress

deployment-controller

payload-processing-e2e-mt-957d1190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-957d1190-6bc8475fdf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-4b78e2-openshift-default-7b7664c598-rz5lx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c85316-8466b65b58-pzr7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c85316-7c94d857f9-kkmck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-c85316-openshift-default-57bfb64984-xgk69

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-888f75-openshift-default-599bd5457b

SuccessfulCreate

Created pod: e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

openshift-ingress

deployment-controller

e2e-shared-a-w3-888f75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-888f75-openshift-default-599bd5457b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-888f75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-888f75

openshift-ingress

multus

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-888f75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-888f75: serviceaccount "payload-processing-e2e-shared-a-w3-888f75" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-888f75: serviceaccount "payload-processing-e2e-shared-a-w3-888f75" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-888f75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-888f75-7678cffd5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46

SuccessfulCreate

Created pod: e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

openshift-ingress

deployment-controller

e2e-shared-b-w3-f1aad1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f1aad1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f1aad1

openshift-ingress

multus

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc0e26-66bc56769c-hv9wz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc0e26-57b598b594-l6jrl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f1aad1: serviceaccount "payload-processing-e2e-shared-b-w3-f1aad1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f1aad1: serviceaccount "payload-processing-e2e-shared-b-w3-f1aad1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f1aad1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f1aad1-b959bf785 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f1aad1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-cc0e26-openshift-default-5d7cf6d7c8-l4z2r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-957d1190-59d5f7df6b-99q2b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-957d1190-6bc8475fdf-b24wb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-957d1190-openshift-default-f6c658df6-qpvlq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-311e2d-openshift-default-57cc74d57b

SuccessfulCreate

Created pod: e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

openshift-ingress

multus

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-311e2d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-311e2d

openshift-ingress

deployment-controller

e2e-api-a-311e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-311e2d-openshift-default-57cc74d57b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-311e2d: serviceaccount "payload-processing-e2e-api-a-311e2d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-311e2d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-311e2d-9d99bf579 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-311e2d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-311e2d-79dcd759c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-311e2d-9d99bf579

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-311e2d-9d99bf579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-311e2d: serviceaccount "payload-processing-e2e-api-a-311e2d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-311e2d-9d99bf579

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-aea238

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-aea238

openshift-ingress

deployment-controller

e2e-api-b-aea238-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-aea238-openshift-default-7579fbf658 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-aea238-openshift-default-7579fbf658

SuccessfulCreate

Created pod: e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x
(x6)

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-aea238-856f85988b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-aea238-856f85988b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-aea238: serviceaccount "payload-processing-e2e-api-b-aea238" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-aea238

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-aea238-84846b6d9c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-aea238-856f85988b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-aea238-84846b6d9c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-aea238-84846b6d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-aea238: serviceaccount "payload-processing-e2e-api-b-aea238" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-aea238-84846b6d9c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-aea238

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-aea238-856f85988b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-311e2d-9d99bf579-4nccn

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-api-a-311e2d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-api-a-311e2d: Operation cannot be fulfilled on endpoints "payload-processing-e2e-api-a-311e2d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-api-a-311e2d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 92ce9044-b86a-4546-872d-c5e12522895e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-311e2d-79dcd759c4-6jttw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-311e2d-openshift-default-57cc74d57b-7gztx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-aea238-84846b6d9c-m4hjw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aea238-856f85988b-vj2bc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-aea238-openshift-default-7579fbf658-nmd8x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b3fb3-6cdcd4f49-qfbn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b3fb3-75c7c747fd-shvhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3182b5-b54fdf565-8hzxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-2b3fb3-openshift-default-779c455c58-lb4v9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3182b5-8d78cc9cd-vdkm7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-3182b5-openshift-default-76dd9fb6bb-b5p7s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-836c16-67555b54-566rj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-836c16-5c6cdc5557-hjf6f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-836c16-openshift-default-758797f458-skhql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d

SuccessfulCreate

Created pod: e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7142e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7142e3

openshift-ingress

multus

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-7142e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7142e3-openshift-default-84f6d7f95d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7142e3: serviceaccount "payload-processing-e2e-ipp-a-7142e3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7142e3-7fc854f565

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7142e3-7fc854f565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7142e3: serviceaccount "payload-processing-e2e-ipp-a-7142e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7142e3-7fc854f565

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7142e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7142e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7142e3-7fc854f565 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-ebb0f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ebb0f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ebb0f4

openshift-ingress

replicaset-controller

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678

SuccessfulCreate

Created pod: e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

openshift-ingress

multus

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ebb0f4: serviceaccount "payload-processing-e2e-ipp-b-ebb0f4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ebb0f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ebb0f4: serviceaccount "payload-processing-e2e-ipp-b-ebb0f4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ebb0f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-4eb285

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4eb285

openshift-ingress

deployment-controller

e2e-ipp-cleanup-4eb285-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-4eb285-openshift-default-7569df8676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676

SuccessfulCreate

Created pod: e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-4eb285

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4eb285: serviceaccount "payload-processing-e2e-ipp-cleanup-4eb285" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-4eb285

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4eb285: serviceaccount "payload-processing-e2e-ipp-cleanup-4eb285" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4eb285-b5d787fdc-mvnmj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4eb285-79bd4d5c98-zfddj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-4eb285-openshift-default-7569df8676-xtnsl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7142e3-7fc854f565-nfd9z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7142e3-79cb9d7b6-k7j74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-7142e3-openshift-default-84f6d7f95d-ht84n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ebb0f4-5cc8db988f-bgchh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ebb0f4-56554d89d6-wj9wp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ebb0f4-openshift-default-5bbcbc8678-cnfjj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-888f75-786b648fb6-r8xf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-888f75-7678cffd5f-sgnqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-888f75-openshift-default-599bd5457b-8mhn2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f1aad1-6f5fc4d8d6-wpq99

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f1aad1-b959bf785-2b8rd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-f1aad1-openshift-default-c6fd9dd46-l98nd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: