Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-65488ff6c7-b8fc4

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65488ff6c7-b8fc4 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-17c562de-openshift-default-88f855448-8xcsb to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8 to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Scheduled

Successfully assigned openshift-ingress/e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4 to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl to ip-10-0-143-252.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bqn5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bqn5b to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-759580-openshift-default-56c58646bd-42hpn to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-759580-74684d8d79-fdx64 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-74969cc5f8-hnjvz

Scheduled

Successfully assigned openshift-ingress/payload-processing-74969cc5f8-hnjvz to ip-10-0-140-183.ec2.internal

openshift-ingress

router-default-647fd6f876-2xxs8

Scheduled

Successfully assigned openshift-ingress/router-default-647fd6f876-2xxs8 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst to ip-10-0-143-252.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-8hhr7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-8hhr7 to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-processing-e2e-mt-17c562de-677f698857-ckph8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-17c562de-677f698857-ckph8 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-f4f46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-f4f46 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-pre-processing-558d9b8847-jqkvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-558d9b8847-jqkvg to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6 to ip-10-0-135-221.ec2.internal

openshift-ingress

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Scheduled

Successfully assigned openshift-ingress/e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9 to ip-10-0-143-252.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vzp6r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vzp6r to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s to ip-10-0-135-221.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp9s8 to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6 to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6 to ip-10-0-140-183.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2 to ip-10-0-135-221.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw to ip-10-0-143-252.ec2.internal

openshift-ingress

kube-auth-proxy-65488ff6c7-8b8lm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65488ff6c7-8b8lm to ip-10-0-140-183.ec2.internal

openshift-ingress

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469 to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz to ip-10-0-143-252.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-647fd6f876 from 0 to 1
(x17)

openshift-ingress

replicaset-controller

router-default-647fd6f876

FailedCreate

Error creating: pods "router-default-647fd6f876-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-647fd6f876

SuccessfulCreate

Created pod: router-default-647fd6f876-2xxs8
(x6)

openshift-ingress

kubelet

router-default-647fd6f876-2xxs8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-647fd6f876-2xxs8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-647fd6f876-2xxs8

Started

Started container router

openshift-ingress

kubelet

router-default-647fd6f876-2xxs8

Created

Created container: router

openshift-ingress

kubelet

router-default-647fd6f876-2xxs8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-647fd6f876-2xxs8

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-8b8lm

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-65488ff6c7

FailedCreate

Error creating: pods "kube-auth-proxy-65488ff6c7-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-65488ff6c7

SuccessfulCreate

Created pod: kube-auth-proxy-65488ff6c7-b8fc4

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-b8fc4

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-65488ff6c7 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-65488ff6c7

SuccessfulCreate

Created pod: kube-auth-proxy-65488ff6c7-8b8lm

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vzp6r

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-8b8lm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-65488ff6c7-b8fc4

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-b8fc4

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65488ff6c7-8b8lm

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vzp6r

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-8b8lm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.349s (3.349s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-8b8lm

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-8b8lm

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-b8fc4

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-b8fc4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.104s (6.104s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.703s (5.703s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-65488ff6c7-b8fc4

Started

Started container kube-auth-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-8hhr7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8hhr7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-8hhr7

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8hhr7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.437s (2.437s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8hhr7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8hhr7

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vzp6r

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

ProbeError

Readiness probe error: Get "http://10.133.0.29:8080/ready": dial tcp 10.133.0.29:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vzp6r

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:8080/ready": dial tcp 10.133.0.29:8080: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-dgc62

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.989s (2.989s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-zp9s8

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bqn5b

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-f4f46
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-f4f46

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f4f46

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bqn5b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-bqn5b

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f4f46

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.747s (1.747s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bqn5b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.708s (1.708s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bqn5b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bqn5b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f4f46

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f4f46

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zp9s8

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f4f46

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bqn5b

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-74969cc5f8

SuccessfulCreate

Created pod: payload-processing-74969cc5f8-hnjvz

openshift-ingress

replicaset-controller

payload-pre-processing-558d9b8847

SuccessfulCreate

Created pod: payload-pre-processing-558d9b8847-jqkvg

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-74969cc5f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-558d9b8847 from 0 to 1

openshift-ingress

multus

payload-pre-processing-558d9b8847-jqkvg

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-74969cc5f8-hnjvz

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-558d9b8847-jqkvg

Pulling

Pulling image "quay.io/maas/odh-praxis-extproc:pr699-76cb977"

openshift-ingress

kubelet

payload-processing-74969cc5f8-hnjvz

Pulling

Pulling image "quay.io/maas/odh-praxis-extproc:pr699-76cb977"

openshift-ingress

kubelet

payload-pre-processing-558d9b8847-jqkvg

Pulled

Successfully pulled image "quay.io/maas/odh-praxis-extproc:pr699-76cb977" in 2.471s (2.471s including waiting). Image size: 120164829 bytes.

openshift-ingress

kubelet

payload-processing-74969cc5f8-hnjvz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-74969cc5f8-hnjvz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-74969cc5f8-hnjvz

Pulled

Successfully pulled image "quay.io/maas/odh-praxis-extproc:pr699-76cb977" in 2.236s (2.236s including waiting). Image size: 120164829 bytes.

openshift-ingress

kubelet

payload-pre-processing-558d9b8847-jqkvg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-558d9b8847-jqkvg

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-900c88

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-900c88

openshift-ingress

deployment-controller

e2e-worker-w0-900c88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-900c88-openshift-default-5c77b9998d from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-9de44d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9de44d-openshift-default-78f95cffcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9de44d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9de44d

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-f0ad35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-f0ad35

openshift-ingress

deployment-controller

e2e-worker-w3-f0ad35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb

SuccessfulCreate

Created pod: e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

openshift-ingress

replicaset-controller

e2e-inf-a-9de44d-openshift-default-78f95cffcd

SuccessfulCreate

Created pod: e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

openshift-ingress

multus

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-900c88-openshift-default-5c77b9998d

SuccessfulCreate

Created pod: e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

openshift-ingress

multus

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9de44d-6546994bb9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9de44d-6546994bb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9de44d: serviceaccount "payload-processing-e2e-inf-a-9de44d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9de44d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9de44d: serviceaccount "payload-processing-e2e-inf-a-9de44d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9de44d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9de44d-6546994bb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9de44d-6546994bb9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-f0ad35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-f0ad35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-f0ad35-654f658459 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f0ad35-654f658459

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f0ad35-654f658459

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-f0ad35-654f658459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f0ad35: serviceaccount "payload-processing-e2e-worker-w3-f0ad35" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f0ad35: serviceaccount "payload-processing-e2e-worker-w3-f0ad35" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-900c88-76d74c4495

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-900c88-76d74c4495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-900c88: serviceaccount "payload-processing-e2e-worker-w0-900c88" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-900c88-76d74c4495

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-900c88

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-900c88-76d74c4495 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-900c88: serviceaccount "payload-processing-e2e-worker-w0-900c88" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-900c88

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.411s (1.411s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-a7a10c67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a7a10c67

openshift-ingress

multus

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-a7a10c67-openshift-default-7b794476d

SuccessfulCreate

Created pod: e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.091s (1.091s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-ait-a7a10c67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a7a10c67-openshift-default-7b794476d from 0 to 1

openshift-ingress

multus

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a7a10c67-5cc7bc6695

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a7a10c67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a7a10c67-5cc7bc6695

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a7a10c67-5cc7bc6695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a7a10c67: serviceaccount "payload-processing-e2e-ait-a7a10c67" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a7a10c67: serviceaccount "payload-processing-e2e-ait-a7a10c67" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a7a10c67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a7a10c67-5cc7bc6695 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-3daa58-openshift-default-5b7b79f9b

SuccessfulCreate

Created pod: e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-3daa58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3daa58-openshift-default-5b7b79f9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3daa58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3daa58
(x2)

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3daa58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3daa58-cbfb8b887 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3daa58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3daa58-cbfb8b887

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3daa58-cbfb8b887

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3daa58-cbfb8b887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3daa58: serviceaccount "payload-processing-e2e-inf-b-3daa58" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3daa58: serviceaccount "payload-processing-e2e-inf-b-3daa58" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj
(x5)

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-a7a10c67-openshift-default-7b794476d-w6ln6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-a7a10c67-5cc7bc6695-mcjrg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7a10c67-65d478bb6b-4s6nk

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-8b287f5b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-8b287f5b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8b287f5b-gw

openshift-ingress

replicaset-controller

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d

SuccessfulCreate

Created pod: e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

openshift-ingress

multus

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8b287f5b-6788947858

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8b287f5b-6788947858

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8b287f5b-6788947858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8b287f5b: serviceaccount "payload-processing-e2e-migrate-8b287f5b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8b287f5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8b287f5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8b287f5b-6788947858 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8b287f5b: serviceaccount "payload-processing-e2e-migrate-8b287f5b" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-8b287f5b-gw-openshift-default-76c69bbb4d-pcs8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8b287f5b-5bbb9fcbbb-bfjjb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-8b287f5b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-8b287f5b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-8b287f5b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-8b287f5b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 42421ea7-b004-47ad-a17a-a86b7087f8bf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-8b287f5b-6788947858-gjxwg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-140d8435-openshift-default-747f6bdc8b

SuccessfulCreate

Created pod: e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

openshift-ingress

deployment-controller

e2e-ait-140d8435-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-140d8435-openshift-default-747f6bdc8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-140d8435

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-140d8435

openshift-ingress

multus

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-140d8435-66648d4786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-140d8435-66648d4786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-140d8435: serviceaccount "payload-processing-e2e-ait-140d8435" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-140d8435-66648d4786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-140d8435-64f5cbcc57

FailedCreate

Error creating: pods "payload-processing-e2e-ait-140d8435-64f5cbcc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-140d8435: serviceaccount "payload-processing-e2e-ait-140d8435" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-140d8435-64f5cbcc57

SuccessfulCreate

Created pod: payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

openshift-ingress

deployment-controller

payload-processing-e2e-ait-140d8435

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-140d8435-64f5cbcc57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-140d8435

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-140d8435-66648d4786 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140d8435-66648d4786-sdvnr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-140d8435-64f5cbcc57-9tsls

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-282a6587

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-282a6587

openshift-ingress

kubelet

e2e-ait-140d8435-openshift-default-747f6bdc8b-p6w6n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-282a6587-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-282a6587-openshift-default-6cfcc7fbf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-282a6587-openshift-default-6cfcc7fbf6

SuccessfulCreate

Created pod: e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-282a6587

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-282a6587-7868594cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-282a6587-7868594cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-282a6587-7868594cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-282a6587-7868594cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-282a6587: serviceaccount "payload-processing-e2e-derive-282a6587" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-282a6587-bf4d57449

SuccessfulCreate

Created pod: payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-282a6587

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-282a6587-bf4d57449 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-282a6587-bf4d57449

FailedCreate

Error creating: pods "payload-processing-e2e-derive-282a6587-bf4d57449-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-282a6587: serviceaccount "payload-processing-e2e-derive-282a6587" not found
(x2)

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-282a6587-7868594cd6-gd5zb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-282a6587-bf4d57449-wfcv9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-282a6587-openshift-default-6cfcc7fbf6-9p5g9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-a0497c3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a0497c3b

openshift-ingress

deployment-controller

e2e-mt-a0497c3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a0497c3b-openshift-default-5c96f48cc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-a0497c3b-openshift-default-5c96f48cc6

SuccessfulCreate

Created pod: e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

openshift-ingress

multus

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a0497c3b-9d7897c49

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

openshift-ingress

multus

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a0497c3b: serviceaccount "payload-processing-e2e-mt-a0497c3b" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a0497c3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a0497c3b-9d7897c49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a0497c3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a0497c3b-7f989864f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a0497c3b-9d7897c49

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a0497c3b-9d7897c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a0497c3b: serviceaccount "payload-processing-e2e-mt-a0497c3b" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-a0497c3b-9d7897c49-2fdz6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a0497c3b-7f989864f8-8gchv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a0497c3b-openshift-default-5c96f48cc6-2d48s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-362ea4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-362ea4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-362ea4

openshift-ingress

replicaset-controller

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6

SuccessfulCreate

Created pod: e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

openshift-ingress

multus

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-362ea4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-362ea4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-362ea4: serviceaccount "payload-processing-e2e-shared-a-w1-362ea4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-362ea4: serviceaccount "payload-processing-e2e-shared-a-w1-362ea4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456

SuccessfulCreate

Created pod: e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

openshift-ingress

deployment-controller

e2e-shared-b-w1-1b0e3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-1b0e3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-1b0e3f

openshift-ingress

multus

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-1b0e3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-1b0e3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1b0e3f: serviceaccount "payload-processing-e2e-shared-b-w1-1b0e3f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1b0e3f: serviceaccount "payload-processing-e2e-shared-b-w1-1b0e3f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:58780->10.133.0.75:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:58780->10.133.0.75:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-17c562de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-17c562de-openshift-default-88f855448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-17c562de-openshift-default-88f855448

SuccessfulCreate

Created pod: e2e-mt-17c562de-openshift-default-88f855448-8xcsb

openshift-ingress

gateway_labeler_controller

e2e-mt-17c562de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-17c562de
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-17c562de-677f698857

SuccessfulCreate

Created pod: payload-processing-e2e-mt-17c562de-677f698857-ckph8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-17c562de-677f698857

FailedCreate

Error creating: pods "payload-processing-e2e-mt-17c562de-677f698857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-17c562de: serviceaccount "payload-processing-e2e-mt-17c562de" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-17c562de: serviceaccount "payload-processing-e2e-mt-17c562de" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-17c562de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-17c562de-677f698857 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-17c562de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-17c562de-6ccbf8f74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-17c562de-677f698857-ckph8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-17c562de-677f698857-ckph8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-17c562de-677f698857-ckph8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-17c562de-677f698857-ckph8

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9de44d-66d4dbb58-wxsd5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9de44d-6546994bb9-f2qw8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-9de44d-openshift-default-78f95cffcd-vljdz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3daa58-9dc576f5d-xwjtj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-3daa58

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-3daa58: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-3daa58": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-3daa58, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc7c6b30-7333-4339-9717-a8cac17db847, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3daa58-cbfb8b887-s2bct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-3daa58-openshift-default-5b7b79f9b-rs469

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c6d10a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c6d10a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6

SuccessfulCreate

Created pod: e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

openshift-ingress

deployment-controller

e2e-shared-a-w2-c6d10a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c6d10a: serviceaccount "payload-processing-e2e-shared-a-w2-c6d10a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c6d10a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c6d10a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c6d10a: serviceaccount "payload-processing-e2e-shared-a-w2-c6d10a" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-415f87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-415f87

openshift-ingress

deployment-controller

e2e-shared-b-w2-415f87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb

SuccessfulCreate

Created pod: e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-415f87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-415f87-7c5c69c49 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-415f87: serviceaccount "payload-processing-e2e-shared-b-w2-415f87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-415f87: serviceaccount "payload-processing-e2e-shared-b-w2-415f87" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-415f87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-17c562de-677f698857-ckph8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-17c562de-6ccbf8f74-cm77g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f0ad35-7f597bc94b-qvkbt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w3-f0ad35

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w3-f0ad35: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w3-f0ad35": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w3-f0ad35, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: be26a426-71cb-4382-9563-cd2a56aed5a8, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f0ad35-654f658459-9zvwn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-f0ad35-openshift-default-5d5478f4cb-d7jst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-17c562de-openshift-default-88f855448-8xcsb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-759580

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-759580

openshift-ingress

multus

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-759580-openshift-default-56c58646bd

SuccessfulCreate

Created pod: e2e-api-a-759580-openshift-default-56c58646bd-42hpn

openshift-ingress

deployment-controller

e2e-api-a-759580-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-759580-openshift-default-56c58646bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-759580-587878fcd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-759580-74684d8d79

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-759580-74684d8d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-759580: serviceaccount "payload-processing-e2e-api-a-759580" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-759580

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-759580-587878fcd6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-759580-587878fcd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-759580-587878fcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-759580: serviceaccount "payload-processing-e2e-api-a-759580" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-759580

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-759580-74684d8d79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-759580-74684d8d79

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-759580-74684d8d79-fdx64

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-b-16a967-openshift-default-84f8fb575d

SuccessfulCreate

Created pod: e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

openshift-ingress

deployment-controller

e2e-api-b-16a967-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-16a967-openshift-default-84f8fb575d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-16a967

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-16a967

openshift-ingress

multus

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-16a967-6cd565498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-16a967-6cd565498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-16a967: serviceaccount "payload-processing-e2e-api-b-16a967" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-16a967-6cd565498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-16a967

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-16a967-6cd565498 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-900c88-5fddc98c7d-ttpqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-900c88-76d74c4495-h9zf2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-16a967-8547f7f44f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-16a967-8547f7f44f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-16a967-8547f7f44f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-16a967: serviceaccount "payload-processing-e2e-api-b-16a967" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-16a967

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-16a967-8547f7f44f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-900c88-openshift-default-5c77b9998d-8h5ld

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-759580-74684d8d79-fdx64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-759580-587878fcd6-24f7b

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-759580

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-759580: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-759580": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-759580, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 500adbf9-2939-4da8-bc78-bdbfdfe4e1cb, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-759580-openshift-default-56c58646bd-42hpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-16a967-6cd565498-6vkxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-16a967-8547f7f44f-h92tc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-16a967-openshift-default-84f8fb575d-7k8kn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-362ea4-6f7c59945c-t7t5s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-362ea4-6f4c6b5d6-65vc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-362ea4-openshift-default-fcbbf5fb6-bcxw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1b0e3f-7fd947c8fd-7jjqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1b0e3f-87f769c5-xrc6g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-1b0e3f-openshift-default-56458c4456-v4nvx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-f61404-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f61404-openshift-default-7b686dd556 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f61404

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f61404

openshift-ingress

replicaset-controller

e2e-ipp-a-f61404-openshift-default-7b686dd556

SuccessfulCreate

Created pod: e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

openshift-ingress

multus

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f61404: serviceaccount "payload-processing-e2e-ipp-a-f61404" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f61404

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f61404

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f61404-67fb574c67 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f61404-67fb574c67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f61404-67fb574c67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f61404: serviceaccount "payload-processing-e2e-ipp-a-f61404" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f61404-67fb574c67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

ProbeError

Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": read tcp 10.133.0.2:52084->10.133.0.104:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Unhealthy

Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": read tcp 10.133.0.2:52084->10.133.0.104:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0ce162

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0ce162

openshift-ingress

deployment-controller

e2e-ipp-b-0ce162-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66

SuccessfulCreate

Created pod: e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

openshift-ingress

multus

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ce162: serviceaccount "payload-processing-e2e-ipp-b-0ce162" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ce162: serviceaccount "payload-processing-e2e-ipp-b-0ce162" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0ce162

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0ce162-6977b9b9f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0ce162

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-f8b852

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-f8b852

openshift-ingress

deployment-controller

e2e-ipp-cleanup-f8b852-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

openshift-ingress

multus

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f8b852: serviceaccount "payload-processing-e2e-ipp-cleanup-f8b852" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-f8b852

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-f8b852

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-f8b852-54f874d445 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f8b852: serviceaccount "payload-processing-e2e-ipp-cleanup-f8b852" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f8b852-845d98fcc4-6whr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f8b852-54f874d445-q89mx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-f8b852-openshift-default-6656849bd6-t455z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f61404-6ddbbdbc74-zhrc2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f61404-67fb574c67-s2hzm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f61404-openshift-default-7b686dd556-dfzlw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ce162-6977b9b9f7-8x2xs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ce162-595fd87f6b-8c8wq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-0ce162-openshift-default-7f4bcf7b66-7fpw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c6d10a-d97dc75cf-fn84k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c6d10a-5d744f84f8-96rcx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-c6d10a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c6d10a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-c6d10a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c6d10a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 45d3837a-aa3c-454f-9ae9-d0fa8a4fd72f, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-c6d10a-openshift-default-6cb96cd5c6-d2gl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-415f87-866bb9b8d6-gfbvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-415f87-7c5c69c49-5jhp6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-415f87-openshift-default-f4c4c8cdb-64p2d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x23)

openshift-ingress

kubelet

payload-processing-74969cc5f8-hnjvz

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-5z5d2); attempting to pull the image may not succeed.
(x24)

openshift-ingress

kubelet

payload-pre-processing-558d9b8847-jqkvg

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-5z5d2); attempting to pull the image may not succeed.