Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x to ip-10-0-131-60.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-sc2x2 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt to ip-10-0-131-149.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch to ip-10-0-136-161.ec2.internal

openshift-ingress

kube-auth-proxy-5c9bc57f57-wn4c7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c9bc57f57-wn4c7 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-dx6xx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-dx6xx to ip-10-0-131-149.ec2.internal

openshift-ingress

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8 to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9 to ip-10-0-131-149.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd to ip-10-0-131-60.ec2.internal

openshift-ingress

kube-auth-proxy-5c9bc57f57-2m99s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c9bc57f57-2m99s to ip-10-0-131-149.ec2.internal

openshift-ingress

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx to ip-10-0-131-60.ec2.internal

openshift-ingress

router-default-5cfdf79c4b-4q7kb

Scheduled

Successfully assigned openshift-ingress/router-default-5cfdf79c4b-4q7kb to ip-10-0-131-149.ec2.internal

openshift-ingress

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw to ip-10-0-131-149.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

Scheduled

Successfully assigned openshift-ingress/e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v to ip-10-0-131-149.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt to ip-10-0-136-161.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fr2wz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fr2wz to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8 to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-38aa0a-openshift-default-656d955f98-m45jz to ip-10-0-131-149.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9qmjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9qmjq to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm to ip-10-0-136-161.ec2.internal

openshift-ingress

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Scheduled

Successfully assigned openshift-ingress/e2e-derive-21b2975e-openshift-default-74768f9944-gblg9 to ip-10-0-131-60.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-2sbcp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2sbcp to ip-10-0-131-149.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8 to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w to ip-10-0-136-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn to ip-10-0-131-149.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5cfdf79c4b from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-5cfdf79c4b

FailedCreate

Error creating: pods "router-default-5cfdf79c4b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5cfdf79c4b

FailedCreate

Error creating: pods "router-default-5cfdf79c4b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5cfdf79c4b

SuccessfulCreate

Created pod: router-default-5cfdf79c4b-4q7kb
(x6)

openshift-ingress

kubelet

router-default-5cfdf79c4b-4q7kb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5cfdf79c4b-4q7kb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5cfdf79c4b-4q7kb

Started

Started container router

openshift-ingress

multus

router-default-5cfdf79c4b-4q7kb

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5cfdf79c4b-4q7kb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-5cfdf79c4b-4q7kb

Created

Created container: router
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-5c9bc57f57

FailedCreate

Error creating: pods "kube-auth-proxy-5c9bc57f57-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5c9bc57f57

SuccessfulCreate

Created pod: kube-auth-proxy-5c9bc57f57-2m99s

openshift-ingress

replicaset-controller

kube-auth-proxy-5c9bc57f57

SuccessfulCreate

Created pod: kube-auth-proxy-5c9bc57f57-wn4c7

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5c9bc57f57 from 0 to 2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-2sbcp

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-wn4c7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5c9bc57f57-wn4c7

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5c9bc57f57-2m99s

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-2m99s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-2sbcp

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-wn4c7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-wn4c7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-wn4c7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.728s (2.728s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-2m99s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.957s (2.957s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-2m99s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c9bc57f57-2m99s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.582s (3.582s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Created

Created container: discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.887s (2.887s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-44sbt

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fr2wz

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fr2wz

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fr2wz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fr2wz

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fr2wz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 15.797s (15.797s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fr2wz

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2sbcp

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-2sbcp
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-sc2x2

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9qmjq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-dx6xx

openshift-ingress

multus

payload-processing-5b54b7fbb7-9qmjq

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-dx6xx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dx6xx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9qmjq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9qmjq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.316s (1.316s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dx6xx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dx6xx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.431s (1.431s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9qmjq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dx6xx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9qmjq

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sc2x2

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-61583b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-61583b

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a2e924

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a2e924

openshift-ingress

deployment-controller

e2e-worker-w0-a2e924-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b from 0 to 1

openshift-ingress

multus

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-worker-w4-04a668-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-04a668-openshift-default-555fc97686 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b

SuccessfulCreate

Created pod: e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-04a668

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-04a668

openshift-ingress

multus

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-inf-a-61583b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-61583b-openshift-default-6b8c5fdcdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd

SuccessfulCreate

Created pod: e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

openshift-ingress

replicaset-controller

e2e-worker-w4-04a668-openshift-default-555fc97686

SuccessfulCreate

Created pod: e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.886s (2.886s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.972s (2.972s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-61583b-65cc6c6cc9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-61583b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-61583b-7d4686d566 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-61583b-65cc6c6cc9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-61583b-65cc6c6cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-61583b: serviceaccount "payload-processing-e2e-inf-a-61583b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-61583b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-61583b-65cc6c6cc9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-61583b-7d4686d566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-61583b-7d4686d566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-61583b: serviceaccount "payload-processing-e2e-inf-a-61583b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-61583b-7d4686d566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

openshift-ingress

multus

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

Started

Started container payload-processing

openshift-ingress

GatewayAuthBootstrap

e2e-autores-38aa0a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-38aa0a-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-38aa0a-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-autores-38aa0a-openshift-default-656d955f98

SuccessfulCreate

Created pod: e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

openshift-ingress

deployment-controller

e2e-autores-38aa0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-38aa0a-openshift-default-656d955f98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-38aa0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-38aa0a

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a2e924

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a2e924-6858df79b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a2e924: serviceaccount "payload-processing-e2e-worker-w0-a2e924" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a2e924-6858df79b9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a2e924-6858df79b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a2e924: serviceaccount "payload-processing-e2e-worker-w0-a2e924" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a2e924-6858df79b9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a2e924

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b

SuccessfulCreate

Created pod: e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-04a668

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-04a668-7bf6696589 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

openshift-ingress

gateway_labeler_controller

e2e-ait-5f80f73c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5f80f73c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-04a668

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-5f80f73c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5f80f73c-openshift-default-6dbfc99d7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-04a668-7bf6696589

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-04a668-7bf6696589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-04a668: serviceaccount "payload-processing-e2e-worker-w4-04a668" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-04a668-7bf6696589

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-04a668: serviceaccount "payload-processing-e2e-worker-w4-04a668" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5f80f73c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5f80f73c-78584b9b59 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5f80f73c-694c657bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

openshift-ingress

multus

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5f80f73c-78584b9b59

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5f80f73c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5f80f73c-694c657bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5f80f73c-78584b9b59

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5f80f73c-78584b9b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5f80f73c: serviceaccount "payload-processing-e2e-ait-5f80f73c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5f80f73c-694c657bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5f80f73c-694c657bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5f80f73c: serviceaccount "payload-processing-e2e-ait-5f80f73c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-38aa0a: serviceaccount "payload-processing-e2e-autores-38aa0a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-38aa0a-758b6f444f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-38aa0a-758b6f444f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-38aa0a: serviceaccount "payload-processing-e2e-autores-38aa0a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5be349

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5be349

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-38aa0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-38aa0a-f6bf585c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-38aa0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-38aa0a-758b6f444f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-38aa0a-758b6f444f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.29s (1.29s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 409ms (409ms including waiting). Image size: 166453408 bytes.

openshift-ingress

deployment-controller

e2e-inf-b-5be349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5be349-openshift-default-bcc9d67b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-b-5be349-openshift-default-bcc9d67b

SuccessfulCreate

Created pod: e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

openshift-ingress

multus

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5be349

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5be349-77cb7c5f9f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5be349-77cb7c5f9f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5be349-77cb7c5f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5be349: serviceaccount "payload-processing-e2e-inf-b-5be349" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5be349

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5be349-6475d864f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5be349-6475d864f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5be349-77cb7c5f9f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

openshift-ingress

multus

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5be349-6475d864f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5be349-6475d864f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5be349: serviceaccount "payload-processing-e2e-inf-b-5be349" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:34642->10.132.0.63:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:34642->10.132.0.63:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5f80f73c-694c657bb-crcld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5f80f73c-78584b9b59-mvrmm

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-9b376ee6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b

SuccessfulCreate

Created pod: e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

openshift-ingress

kubelet

e2e-ait-5f80f73c-openshift-default-6dbfc99d7b-n5rtv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-9b376ee6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9b376ee6-gw

openshift-ingress

multus

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.435s (2.435s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9b376ee6-7ccc596594

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9b376ee6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9b376ee6-7ccc596594 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9b376ee6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9b376ee6-7ccc596594

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9b376ee6-7ccc596594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9b376ee6: serviceaccount "payload-processing-e2e-migrate-9b376ee6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9b376ee6: serviceaccount "payload-processing-e2e-migrate-9b376ee6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-9b376ee6-7ccc596594-cdqj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9b376ee6-f76f5b754-rkvj7

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-450ffc30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-450ffc30

openshift-ingress

replicaset-controller

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8

SuccessfulCreate

Created pod: e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

openshift-ingress

deployment-controller

e2e-ait-450ffc30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-450ffc30-openshift-default-7bfcfcfbf8 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9b376ee6-gw-openshift-default-5fcd8d687b-f46fx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-450ffc30: serviceaccount "payload-processing-e2e-ait-450ffc30" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-450ffc30-7d76b68f89

FailedCreate

Error creating: pods "payload-processing-e2e-ait-450ffc30-7d76b68f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-450ffc30: serviceaccount "payload-processing-e2e-ait-450ffc30" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-450ffc30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-450ffc30-7d76b68f89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-450ffc30-7d76b68f89

SuccessfulCreate

Created pod: payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-450ffc30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-450ffc30-7d76b68f89-zlxh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-450ffc30-66bd84b8b6-vlrbr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-21b2975e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-21b2975e

openshift-ingress

replicaset-controller

e2e-derive-21b2975e-openshift-default-74768f9944

SuccessfulCreate

Created pod: e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

openshift-ingress

deployment-controller

e2e-derive-21b2975e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-21b2975e-openshift-default-74768f9944 from 0 to 1

openshift-ingress

multus

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-38aa0a-f6bf585c8-r796n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-450ffc30-openshift-default-7bfcfcfbf8-kvkk9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-autores-38aa0a-758b6f444f-7b2qb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-21b2975e: serviceaccount "payload-processing-e2e-derive-21b2975e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-21b2975e-656b544f6f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-21b2975e-656b544f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-21b2975e: serviceaccount "payload-processing-e2e-derive-21b2975e" not found

openshift-ingress

multus

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-21b2975e-656b544f6f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-21b2975e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-21b2975e-64b5fb7466 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-21b2975e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-21b2975e-656b544f6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-21b2975e-656b544f6f-fqtxj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-21b2975e-64b5fb7466-cxxhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-38aa0a-openshift-default-656d955f98-m45jz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-b4e91c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b4e91c

openshift-ingress

deployment-controller

e2e-explicit-b4e91c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b4e91c-openshift-default-75f9cd9cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-b4e91c-openshift-default-75f9cd9cb

SuccessfulCreate

Created pod: e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

openshift-ingress

multus

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-21b2975e-openshift-default-74768f9944-gblg9

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b4e91c: serviceaccount "payload-processing-e2e-explicit-b4e91c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b4e91c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b4e91c-5d7bfd87fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b4e91c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b4e91c: serviceaccount "payload-processing-e2e-explicit-b4e91c" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-f9a7df96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f9a7df96

openshift-ingress

deployment-controller

e2e-mt-f9a7df96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f9a7df96-openshift-default-6fc96b9c5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b

SuccessfulCreate

Created pod: e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f9a7df96: serviceaccount "payload-processing-e2e-mt-f9a7df96" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f9a7df96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f9a7df96-8b8c86758 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f9a7df96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f9a7df96: serviceaccount "payload-processing-e2e-mt-f9a7df96" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-f9a7df96-7ddf4b9fc7-qxnw9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f9a7df96-8b8c86758-t5xzg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f9a7df96-openshift-default-6fc96b9c5b-qtsn8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b4e91c-5d957cb5c4-z7qw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b4e91c-5d7bfd87fc-7z8q2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b

SuccessfulCreate

Created pod: e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

openshift-ingress

deployment-controller

e2e-shared-a-w2-2a487c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2a487c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2a487c

openshift-ingress

multus

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2a487c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2a487c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2a487c: serviceaccount "payload-processing-e2e-shared-a-w2-2a487c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2a487c: serviceaccount "payload-processing-e2e-shared-a-w2-2a487c" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-5068d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5068d9-openshift-default-7789b4b48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48

SuccessfulCreate

Created pod: e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5068d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5068d9

openshift-ingress

multus

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-e8f833

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-e8f833

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-e8f833-openshift-default-574c6d4c6b

SuccessfulCreate

Created pod: e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5068d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5068d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b from 0 to 1

openshift-ingress

deployment-controller

e2e-noten-e8f833-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-e8f833-openshift-default-574c6d4c6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5068d9: serviceaccount "payload-processing-e2e-shared-b-w2-5068d9" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5068d9: serviceaccount "payload-processing-e2e-shared-b-w2-5068d9" not found

openshift-ingress

multus

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

openshift-ingress

kubelet

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-b4e91c-openshift-default-75f9cd9cb-pglsz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-e9a75910-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e9a75910-openshift-default-5689b94cb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-e9a75910-openshift-default-5689b94cb8

SuccessfulCreate

Created pod: e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

openshift-ingress

GatewayAuthBootstrap

e2e-mt-e9a75910

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-e9a75910-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-e9a75910-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-e9a75910

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e9a75910

openshift-ingress

multus

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e9a75910-7cd8d8847c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e9a75910-7cd8d8847c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e9a75910: serviceaccount "payload-processing-e2e-mt-e9a75910" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e9a75910-7cd8d8847c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e9a75910

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e9a75910-7cd8d8847c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e9a75910-68b68b5466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e9a75910-68b68b5466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e9a75910: serviceaccount "payload-processing-e2e-mt-e9a75910" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e9a75910-68b68b5466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e9a75910

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e9a75910-68b68b5466 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-61583b-65cc6c6cc9-2wxqs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-61583b-7d4686d566-knxzs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-61583b-openshift-default-6b8c5fdcdd-c6dlv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-e8f833-openshift-default-574c6d4c6b-zstvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5be349-6475d864f8-jt2zv

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-5be349

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-5be349: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-5be349": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-5be349, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bed8ef53-b87a-4eda-8b4d-61040c524790, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5be349-77cb7c5f9f-gknq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-5be349-openshift-default-bcc9d67b-2dmmt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-b0e30e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b0e30e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b0e30e

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66

SuccessfulCreate

Created pod: e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

openshift-ingress

multus

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b0e30e: serviceaccount "payload-processing-e2e-shared-a-w3-b0e30e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b0e30e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b0e30e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b0e30e-857b6887df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b0e30e: serviceaccount "payload-processing-e2e-shared-a-w3-b0e30e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5d6124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5d6124

openshift-ingress

deployment-controller

e2e-shared-b-w3-5d6124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8

SuccessfulCreate

Created pod: e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

openshift-ingress

multus

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5d6124: serviceaccount "payload-processing-e2e-shared-b-w3-5d6124" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5d6124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5d6124: serviceaccount "payload-processing-e2e-shared-b-w3-5d6124" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5d6124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-e9a75910-7cd8d8847c-v4qch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e9a75910-68b68b5466-nkssq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e9a75910-openshift-default-5689b94cb8-6jnqm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-49e81a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-49e81a

openshift-ingress

replicaset-controller

e2e-api-a-49e81a-openshift-default-69bddcc5cb

SuccessfulCreate

Created pod: e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

openshift-ingress

deployment-controller

e2e-api-a-49e81a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-49e81a-openshift-default-69bddcc5cb from 0 to 1

openshift-ingress

multus

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-49e81a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-49e81a-6f68475846 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-49e81a-6f68475846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-49e81a-5966f86c9f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-49e81a-5966f86c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-49e81a: serviceaccount "payload-processing-e2e-api-a-49e81a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-49e81a-6f68475846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-49e81a-6f68475846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-49e81a: serviceaccount "payload-processing-e2e-api-a-49e81a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-49e81a-5966f86c9f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-49e81a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-49e81a-5966f86c9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-513a51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-513a51

openshift-ingress

deployment-controller

e2e-api-b-513a51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-513a51-openshift-default-7b4dbc5674 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-513a51-openshift-default-7b4dbc5674

SuccessfulCreate

Created pod: e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

openshift-ingress

multus

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-513a51-58875748fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-513a51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-513a51-94c5fbdcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-513a51-94c5fbdcc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-513a51-94c5fbdcc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-513a51-94c5fbdcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-513a51: serviceaccount "payload-processing-e2e-api-b-513a51" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-513a51-58875748fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-513a51-58875748fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-513a51: serviceaccount "payload-processing-e2e-api-b-513a51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-513a51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-513a51-58875748fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a2e924-6858df79b9-8lsdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a2e924-64c4985df4-qlgtg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-a2e924-openshift-default-5bb89d9d6b-6t2jw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-49e81a-5966f86c9f-bp54j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49e81a-6f68475846-6bw8w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-49e81a-openshift-default-69bddcc5cb-4clr5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-513a51-58875748fd-b9nh8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-513a51-94c5fbdcc-jh9g8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-513a51-openshift-default-7b4dbc5674-842h5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2a487c-5bbffc5447-6756r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-2a487c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2a487c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-2a487c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2a487c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 82c95ebd-5ff7-41bb-a050-073b1369973d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2a487c-56769d894b-spzms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2a487c-openshift-default-565b9b7f5b-r6f96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5068d9-6dcb76fd5f-zjd7c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5068d9-68774ff6b-vf756

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5068d9-openshift-default-7789b4b48-mtdx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-04a668-7bf6696589-knqm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-04a668-c985bd6f8-4zbzn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-04a668-openshift-default-555fc97686-sf64v

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-f32129-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f32129-openshift-default-7698d45864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f32129-openshift-default-7698d45864

SuccessfulCreate

Created pod: e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f32129

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f32129

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-f32129

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-f32129-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-f32129-authn-ssl" already exists
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f32129: serviceaccount "payload-processing-e2e-ipp-a-f32129" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f32129-8668476895

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f32129-8668476895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f32129: serviceaccount "payload-processing-e2e-ipp-a-f32129" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f32129-8668476895

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f32129

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f32129-8668476895 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f32129

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f32129-668746f8b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-4e754a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4e754a-openshift-default-666c4f55b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-4e754a-openshift-default-666c4f55b

SuccessfulCreate

Created pod: e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4e754a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4e754a

openshift-ingress

multus

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4e754a: serviceaccount "payload-processing-e2e-ipp-b-4e754a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4e754a-554f4c979f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4e754a-554f4c979f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4e754a: serviceaccount "payload-processing-e2e-ipp-b-4e754a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4e754a-554f4c979f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4e754a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4e754a-554f4c979f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4e754a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-1593f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-1593f0

openshift-ingress

deployment-controller

e2e-ipp-cleanup-1593f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1593f0: serviceaccount "payload-processing-e2e-ipp-cleanup-1593f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-1593f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1593f0: serviceaccount "payload-processing-e2e-ipp-cleanup-1593f0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-1593f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1593f0-c747d9b95-9g9z4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1593f0-5db7f9f558-52kvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-1593f0-openshift-default-c5cf7769b-dkhcd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f32129-668746f8b6-t8bzp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f32129-8668476895-kg9xd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f32129-openshift-default-7698d45864-fvr8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4e754a-bf47f64b6-mq5sf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4e754a-554f4c979f-ctqj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-4e754a-openshift-default-666c4f55b-xxdcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b0e30e-857b6887df-49v7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b0e30e-bddd54478-shjhj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b0e30e-openshift-default-5f8c8b5c66-mmh5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d6124-5f7d79dcc8-4s7wr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d6124-57c9fcd65c-g6nrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5d6124-openshift-default-b4b4969c8-6b9jv

Killing

Stopping container istio-proxy