Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6 to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m to ip-10-0-142-211.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcn99nw to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4 to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285 to ip-10-0-142-211.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7 to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp to ip-10-0-137-44.ec2.internal

openshift-ingress

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7 to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn to ip-10-0-137-44.ec2.internal

openshift-ingress

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7 to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8 to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4 to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn to ip-10-0-137-44.ec2.internal

openshift-ingress

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5b160c-6d47696cf-prcbn to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-24efea-7d5d9d647-fls48 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94 to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9tfpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9tfpz to ip-10-0-137-44.ec2.internal

openshift-ingress

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Scheduled

Successfully assigned openshift-ingress/e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7 to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-35e777-openshift-default-775c996888-28smq to ip-10-0-142-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nbn5h

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbn5h to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9 to ip-10-0-142-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-mhpvb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb to ip-10-0-137-44.ec2.internal

openshift-ingress

kube-auth-proxy-57ddc9f5f6-4tg7c

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-57ddc9f5f6-4tg7c to ip-10-0-142-211.ec2.internal

openshift-ingress

kube-auth-proxy-57ddc9f5f6-m2j22

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22 to ip-10-0-137-44.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t to ip-10-0-137-44.ec2.internal

openshift-ingress

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 to ip-10-0-137-44.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb to ip-10-0-137-44.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-8gmbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-8gmbg to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr to ip-10-0-141-125.ec2.internal

openshift-ingress

router-default-7448bd7fc8-p7xdg

Scheduled

Successfully assigned openshift-ingress/router-default-7448bd7fc8-p7xdg to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v to ip-10-0-141-125.ec2.internal

openshift-ingress

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5b160c-openshift-default-6788979f8d-tv587 to ip-10-0-142-211.ec2.internal

openshift-ingress

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 to ip-10-0-137-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6 to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg to ip-10-0-141-125.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984 to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj to ip-10-0-142-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq to ip-10-0-141-125.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7448bd7fc8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7448bd7fc8

FailedCreate

Error creating: pods "router-default-7448bd7fc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7448bd7fc8

FailedCreate

Error creating: pods "router-default-7448bd7fc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7448bd7fc8

SuccessfulCreate

Created pod: router-default-7448bd7fc8-p7xdg
(x6)

openshift-ingress

kubelet

router-default-7448bd7fc8-p7xdg

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7448bd7fc8-p7xdg

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7448bd7fc8-p7xdg

Started

Started container router

openshift-ingress

kubelet

router-default-7448bd7fc8-p7xdg

Created

Created container: router

openshift-ingress

kubelet

router-default-7448bd7fc8-p7xdg

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-7448bd7fc8-p7xdg

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-57ddc9f5f6

FailedCreate

Error creating: pods "kube-auth-proxy-57ddc9f5f6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-57ddc9f5f6

SuccessfulCreate

Created pod: kube-auth-proxy-57ddc9f5f6-4tg7c

openshift-ingress

replicaset-controller

kube-auth-proxy-57ddc9f5f6

SuccessfulCreate

Created pod: kube-auth-proxy-57ddc9f5f6-m2j22

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-57ddc9f5f6 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-57ddc9f5f6-4tg7c

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-m2j22

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-57ddc9f5f6-m2j22

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-4tg7c

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-mhpvb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-m2j22

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mhpvb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-m2j22

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-4tg7c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.627s (2.627s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-4tg7c

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-4tg7c

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-57ddc9f5f6-m2j22

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.75s (2.75s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-mhpvb

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mhpvb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.549s (2.549s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mhpvb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mhpvb

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.762s (2.762s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x9tcs

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.849s (2.849s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcn99nw
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Unhealthy

Startup probe failed: Get "http://10.133.0.18:15021/healthz/ready": dial tcp 10.133.0.18:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

ProbeError

Startup probe error: Get "http://10.133.0.18:15021/healthz/ready": dial tcp 10.133.0.18:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcn99nw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nbn5h

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nbn5h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nbn5h

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nbn5h

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nbn5h

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nbn5h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 8.037s (8.037s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-mhpvb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mhpvb

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-t5pnb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.781s (2.781s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9tfpz

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-8gmbg

openshift-ingress

multus

payload-processing-5b54b7fbb7-9tfpz

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9tfpz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-8gmbg

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8gmbg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8gmbg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.414s (1.414s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8gmbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8gmbg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9tfpz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9tfpz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.196s (2.196s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9tfpz

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t5pnb

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-e919c5-openshift-default-6765db6bdb

SuccessfulCreate

Created pod: e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

openshift-ingress

deployment-controller

e2e-inf-a-e919c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e919c5-openshift-default-6765db6bdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-35e777

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-35e777

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e919c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e919c5

openshift-ingress

replicaset-controller

e2e-worker-w0-f12741-openshift-default-656cd87cbb

SuccessfulCreate

Created pod: e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f12741

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f12741

openshift-ingress

deployment-controller

e2e-worker-w0-f12741-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f12741-openshift-default-656cd87cbb from 0 to 1

openshift-ingress

multus

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-35e777-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-35e777-openshift-default-775c996888 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-35e777-openshift-default-775c996888

SuccessfulCreate

Created pod: e2e-worker-w4-35e777-openshift-default-775c996888-28smq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e919c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e919c5-65978b484b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e919c5-65978b484b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e919c5-6d8485488f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e919c5-6d8485488f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e919c5: serviceaccount "payload-processing-e2e-inf-a-e919c5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e919c5-65978b484b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e919c5-65978b484b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e919c5: serviceaccount "payload-processing-e2e-inf-a-e919c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e919c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e919c5-6d8485488f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e919c5-6d8485488f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-35e777

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-35e777

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-35e777: serviceaccount "payload-processing-e2e-worker-w4-35e777" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-35e777: serviceaccount "payload-processing-e2e-worker-w4-35e777" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f12741: serviceaccount "payload-processing-e2e-worker-w0-f12741" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f12741

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f12741: serviceaccount "payload-processing-e2e-worker-w0-f12741" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f12741

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f12741-7c879744b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-b2d1bd14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b2d1bd14

openshift-ingress

deployment-controller

e2e-autores-5b160c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5b160c-openshift-default-6788979f8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b2d1bd14-openshift-default-f56596db4

SuccessfulCreate

Created pod: e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-5b160c-openshift-default-6788979f8d

SuccessfulCreate

Created pod: e2e-autores-5b160c-openshift-default-6788979f8d-tv587

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-5b160c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5b160c

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-b2d1bd14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b2d1bd14-openshift-default-f56596db4 from 0 to 1

openshift-ingress

multus

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5b160c-6d47696cf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5b160c-6d47696cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5b160c: serviceaccount "payload-processing-e2e-autores-5b160c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5b160c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5b160c-69796f8978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5b160c-69796f8978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5b160c-69796f8978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5b160c-69796f8978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5b160c: serviceaccount "payload-processing-e2e-autores-5b160c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5b160c-6d47696cf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5b160c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5b160c-6d47696cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b2d1bd14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b2d1bd14: serviceaccount "payload-processing-e2e-ait-b2d1bd14" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b2d1bd14-5df598bc9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b2d1bd14-5df598bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b2d1bd14: serviceaccount "payload-processing-e2e-ait-b2d1bd14" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b2d1bd14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b2d1bd14-5df598bc9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b2d1bd14-5df598bc9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

openshift-ingress

kubelet

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-7e6f5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-7e6f5e-openshift-default-cf76475f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-7e6f5e-openshift-default-cf76475f6

SuccessfulCreate

Created pod: e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

openshift-ingress

gateway_labeler_controller

e2e-inf-b-7e6f5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-7e6f5e
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-7e6f5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7e6f5e: serviceaccount "payload-processing-e2e-inf-b-7e6f5e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-7e6f5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7e6f5e: serviceaccount "payload-processing-e2e-inf-b-7e6f5e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Created

Created container: istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.984s (3.984s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b2d1bd14-77cb5bd6d6-66b92

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-b2d1bd14-openshift-default-f56596db4-rflwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-b2d1bd14-5df598bc9-p7wdl

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-762b41ed-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-762b41ed-gw-openshift-default-64c6994548 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-migrate-762b41ed-gw-openshift-default-64c6994548

SuccessfulCreate

Created pod: e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

openshift-ingress

gateway_labeler_controller

e2e-migrate-762b41ed-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-762b41ed-gw

openshift-ingress

multus

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-762b41ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-762b41ed-6559fdc98b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-762b41ed: serviceaccount "payload-processing-e2e-migrate-762b41ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-762b41ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-762b41ed-6559fdc98b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-762b41ed-6559fdc98b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-762b41ed-6559fdc98b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-762b41ed: serviceaccount "payload-processing-e2e-migrate-762b41ed" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-762b41ed-gw-openshift-default-64c6994548-qk285

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-762b41ed-9cd4d855d-s8dpg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-dad794b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-dad794b4-openshift-default-67c58bfb86 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-dad794b4-openshift-default-67c58bfb86

SuccessfulCreate

Created pod: e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

openshift-ingress

gateway_labeler_controller

e2e-ait-dad794b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-dad794b4

openshift-ingress

multus

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dad794b4: serviceaccount "payload-processing-e2e-ait-dad794b4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dad794b4-b69fbbc57

FailedCreate

Error creating: pods "payload-processing-e2e-ait-dad794b4-b69fbbc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dad794b4: serviceaccount "payload-processing-e2e-ait-dad794b4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dad794b4-b69fbbc57

SuccessfulCreate

Created pod: payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

openshift-ingress

deployment-controller

payload-processing-e2e-ait-dad794b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-dad794b4-b69fbbc57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-dad794b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

openshift-ingress

kubelet

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-dad794b4-b69fbbc57-zzlnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dad794b4-6688fbf6f8-jls7d

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4

SuccessfulCreate

Created pod: e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

openshift-ingress

kubelet

e2e-ait-dad794b4-openshift-default-67c58bfb86-m5d2l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-7a9aa317

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-7a9aa317

openshift-ingress

deployment-controller

e2e-derive-7a9aa317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4 from 0 to 1

openshift-ingress

multus

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-7a9aa317

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-7a9aa317-56645fc5db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7a9aa317: serviceaccount "payload-processing-e2e-derive-7a9aa317" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7a9aa317-55ff94b669

FailedCreate

Error creating: pods "payload-processing-e2e-derive-7a9aa317-55ff94b669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7a9aa317: serviceaccount "payload-processing-e2e-derive-7a9aa317" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-7a9aa317

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-7a9aa317-55ff94b669 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7a9aa317-55ff94b669

SuccessfulCreate

Created pod: payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

openshift-ingress

kubelet

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5b160c-69796f8978-bwpbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5b160c-6d47696cf-prcbn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-7a9aa317-55ff94b669-qftmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7a9aa317-56645fc5db-mbvjj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-5b160c-openshift-default-6788979f8d-tv587

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-b75330-openshift-default-7567c75fb4

SuccessfulCreate

Created pod: e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

openshift-ingress

deployment-controller

e2e-explicit-b75330-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b75330-openshift-default-7567c75fb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-b75330

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b75330
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b75330-5d46bcdfbf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b75330-5d46bcdfbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b75330: serviceaccount "payload-processing-e2e-explicit-b75330" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b75330

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b75330-78ccd7ff74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b75330: serviceaccount "payload-processing-e2e-explicit-b75330" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b75330

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b75330-5d46bcdfbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b75330-5d46bcdfbf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-a21586a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a21586a5-openshift-default-86d67cbcb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-a21586a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a21586a5

openshift-ingress

replicaset-controller

e2e-mt-a21586a5-openshift-default-86d67cbcb8

SuccessfulCreate

Created pod: e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

openshift-ingress

multus

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a21586a5-755bdf4c97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a21586a5-755bdf4c97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a21586a5: serviceaccount "payload-processing-e2e-mt-a21586a5" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a21586a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a21586a5-6db597f754 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a21586a5-6db597f754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a21586a5-6db597f754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a21586a5: serviceaccount "payload-processing-e2e-mt-a21586a5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a21586a5-6db597f754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a21586a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a21586a5-755bdf4c97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a21586a5-755bdf4c97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

openshift-ingress

kubelet

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b75330-78ccd7ff74-l8984

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-b75330

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-b75330: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-b75330": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-b75330, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c74284b7-181b-466d-95d0-901448645af7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-b75330-5d46bcdfbf-mgkb8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a21586a5-6db597f754-h9w6k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a21586a5-755bdf4c97-4hgk6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-5cb5f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb

SuccessfulCreate

Created pod: e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5cb5f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5cb5f4

openshift-ingress

multus

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-d3fe19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d3fe19-openshift-default-694bcc8f68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-d3fe19-openshift-default-694bcc8f68

SuccessfulCreate

Created pod: e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

openshift-ingress

gateway_labeler_controller

e2e-noten-d3fe19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d3fe19

openshift-ingress

kubelet

e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5cb5f4: serviceaccount "payload-processing-e2e-shared-a-w2-5cb5f4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5cb5f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5cb5f4: serviceaccount "payload-processing-e2e-shared-a-w2-5cb5f4" not found

openshift-ingress

kubelet

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5cb5f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd from 0 to 1

openshift-ingress

multus

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.763s (2.763s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-afd794-openshift-default-688d446bcd

SuccessfulCreate

Created pod: e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

openshift-ingress

deployment-controller

e2e-shared-b-w2-afd794-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-afd794-openshift-default-688d446bcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-afd794

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-afd794
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-afd794

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-afd794

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-afd794: serviceaccount "payload-processing-e2e-shared-b-w2-afd794" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-afd794: serviceaccount "payload-processing-e2e-shared-b-w2-afd794" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-9f68da5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9f68da5e-openshift-default-76d446675b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-9f68da5e-openshift-default-76d446675b

SuccessfulCreate

Created pod: e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

openshift-ingress

gateway_labeler_controller

e2e-mt-9f68da5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9f68da5e

openshift-ingress

multus

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9f68da5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9f68da5e-6b96676974 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f68da5e-7d567bf897

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9f68da5e-7d567bf897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f68da5e: serviceaccount "payload-processing-e2e-mt-9f68da5e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9f68da5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9f68da5e-7d567bf897 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f68da5e-6b96676974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9f68da5e-6b96676974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f68da5e: serviceaccount "payload-processing-e2e-mt-9f68da5e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f68da5e-6b96676974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f68da5e-7d567bf897

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e919c5-65978b484b-pnzdg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e919c5-6d8485488f-mkpfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-d3fe19-openshift-default-694bcc8f68-x7td7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e919c5-openshift-default-6765db6bdb-xbh5m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7e6f5e-6cc6467d6b-2zwjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7e6f5e-dcfcb84cf-gvh8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-7e6f5e-openshift-default-cf76475f6-vl7f9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-7d7821-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7d7821

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7d7821

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db

SuccessfulCreate

Created pod: e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

openshift-ingress

multus

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7d7821

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7d7821-5c5977d69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7d7821

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7d7821: serviceaccount "payload-processing-e2e-shared-a-w3-7d7821" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7d7821: serviceaccount "payload-processing-e2e-shared-a-w3-7d7821" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4e0323

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4e0323

openshift-ingress

deployment-controller

e2e-shared-b-w3-4e0323-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648

SuccessfulCreate

Created pod: e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

openshift-ingress

multus

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4e0323

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4e0323: serviceaccount "payload-processing-e2e-shared-b-w3-4e0323" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4e0323

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4e0323-745b4dd895 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4e0323: serviceaccount "payload-processing-e2e-shared-b-w3-4e0323" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f68da5e-6b96676974-mksf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9f68da5e-7d567bf897-n7jbc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-9f68da5e-openshift-default-76d446675b-jp7t7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-1132e5-openshift-default-556cdcdfb6

SuccessfulCreate

Created pod: e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

openshift-ingress

deployment-controller

e2e-api-a-1132e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1132e5-openshift-default-556cdcdfb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-1132e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1132e5

openshift-ingress

multus

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1132e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1132e5-7f4bbdf5f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1132e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1132e5-8d667bcbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1132e5: serviceaccount "payload-processing-e2e-api-a-1132e5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1132e5: serviceaccount "payload-processing-e2e-api-a-1132e5" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-24efea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-24efea

openshift-ingress

replicaset-controller

e2e-api-b-24efea-openshift-default-649dd7b56

SuccessfulCreate

Created pod: e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

openshift-ingress

deployment-controller

e2e-api-b-24efea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-24efea-openshift-default-649dd7b56 from 0 to 1

openshift-ingress

multus

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-24efea-7d5d9d647

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-24efea-7d5d9d647-fls48
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-24efea-7d5d9d647

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-24efea-7d5d9d647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-24efea: serviceaccount "payload-processing-e2e-api-b-24efea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-24efea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-24efea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-24efea-7d5d9d647 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-24efea: serviceaccount "payload-processing-e2e-api-b-24efea" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1132e5-8d667bcbb-gnk5s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1132e5-7f4bbdf5f7-bdm94

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-1132e5-openshift-default-556cdcdfb6-tdrvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-24efea-7d5d9d647-fls48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-24efea-7d6c8bb4fd-wblxq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-24efea-openshift-default-649dd7b56-rc7wk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f12741-7ff4fd4fbf-fv66v

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-worker-w0-f12741

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-worker-w0-f12741: Operation cannot be fulfilled on endpoints "payload-processing-e2e-worker-w0-f12741": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-worker-w0-f12741, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 57c78440-ed81-4731-a5a9-8ead8de6ff8e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f12741-7c879744b6-fksdk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5cb5f4-5d689897f-pshrr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-5cb5f4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5cb5f4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-5cb5f4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5cb5f4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6e00f15c-c95d-497e-b303-dc8ed033ab8b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5cb5f4-7bb6676fcd-j7444

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-35e777-85bfc845c8-7m9tv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-35e777-7fcbcbfcbc-x2mq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-afd794-86859f975d-6zsqf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-afd794-6b8ff8b5cc-m7sq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-35e777-openshift-default-775c996888-28smq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-afd794-openshift-default-688d446bcd-6bcv8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-6a5690-openshift-default-957c86568

SuccessfulCreate

Created pod: e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

openshift-ingress

deployment-controller

e2e-ipp-a-6a5690-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6a5690-openshift-default-957c86568 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6a5690

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6a5690

openshift-ingress

multus

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6a5690

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6a5690: serviceaccount "payload-processing-e2e-ipp-a-6a5690" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6a5690

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6a5690-78cff4d7c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6a5690: serviceaccount "payload-processing-e2e-ipp-a-6a5690" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-077193-openshift-default-54fc689874

SuccessfulCreate

Created pod: e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

openshift-ingress

deployment-controller

e2e-ipp-b-077193-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-077193-openshift-default-54fc689874 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-077193

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-077193

openshift-ingress

multus

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-077193-6d9544c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-077193-6d9544c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-077193-6d9544c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-077193: serviceaccount "payload-processing-e2e-ipp-b-077193" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-077193-58cb899fb9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-077193

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-077193-6d9544c74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-077193-58cb899fb9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-077193-58cb899fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-077193: serviceaccount "payload-processing-e2e-ipp-b-077193" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-077193

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-077193-58cb899fb9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3b9cac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3b9cac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3b9cac

openshift-ingress

multus

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3b9cac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3b9cac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3b9cac: serviceaccount "payload-processing-e2e-ipp-cleanup-3b9cac" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3b9cac: serviceaccount "payload-processing-e2e-ipp-cleanup-3b9cac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b9cac-565f76f4cd-28f8v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b9cac-fd64859b5-jfrx6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-3b9cac-openshift-default-6b6bc8766-ntkmx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a5690-78cff4d7c5-k9srn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a5690-6656787cbb-6h4sr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-6a5690-openshift-default-957c86568-bb7v7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-077193-58cb899fb9-49zpp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-077193-6d9544c74-lbct6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-077193-openshift-default-54fc689874-gwrxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7d7821-5c5977d69-77fgl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7d7821-6688c4fd78-vffm5

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-7d7821

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7d7821: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-7d7821": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7d7821, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ebe0c0bb-e6f9-435f-a41a-0dc69993fde4, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-7d7821-openshift-default-5c97dd94db-wm46s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Unhealthy

Readiness probe failed: dial tcp 10.133.0.74:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e0323-745b4dd895-fl8rv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e0323-dcbd7bc4-76fcf

Unhealthy

Readiness probe failed: dial tcp 10.133.0.73:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-4e0323-openshift-default-6db4bb5648-wz8t4

Killing

Stopping container istio-proxy