Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk to ip-10-0-138-244.ec2.internal

openshift-ingress

kube-auth-proxy-798674575b-dp5dl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-798674575b-dp5dl to ip-10-0-138-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-n7z45

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n7z45 to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc to ip-10-0-141-4.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-9kzn4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kzn4 to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-ab5750-6f8df94989-kx65f to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m to ip-10-0-141-4.ec2.internal

openshift-ingress

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4 to ip-10-0-141-4.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m to ip-10-0-138-23.ec2.internal

openshift-ingress

router-default-5b98ff7586-7xqbj

Scheduled

Successfully assigned openshift-ingress/router-default-5b98ff7586-7xqbj to ip-10-0-138-23.ec2.internal

openshift-ingress

router-default-5b98ff7586-7xqbj

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-5b54b7fbb7-265v7

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-265v7 to ip-10-0-141-4.ec2.internal

openshift-ingress

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95 to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4 to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn to ip-10-0-141-4.ec2.internal

openshift-ingress

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f16030-openshift-default-699d768b48-gqkcq to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9 to ip-10-0-138-244.ec2.internal

openshift-ingress

kube-auth-proxy-798674575b-cjnkz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-798674575b-cjnkz to ip-10-0-141-4.ec2.internal

openshift-ingress

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-27xw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-27xw5 to ip-10-0-141-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t to ip-10-0-138-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm to ip-10-0-138-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-bh7f6 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg to ip-10-0-138-244.ec2.internal

openshift-ingress

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk to ip-10-0-138-244.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b98ff7586 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-5b98ff7586

FailedCreate

Error creating: pods "router-default-5b98ff7586-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5b98ff7586

FailedCreate

Error creating: pods "router-default-5b98ff7586-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5b98ff7586

SuccessfulCreate

Created pod: router-default-5b98ff7586-7xqbj
(x6)

openshift-ingress

kubelet

router-default-5b98ff7586-7xqbj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5b98ff7586-7xqbj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5b98ff7586-7xqbj

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b98ff7586-7xqbj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-5b98ff7586-7xqbj

Created

Created container: router

openshift-ingress

kubelet

router-default-5b98ff7586-7xqbj

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-798674575b from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-798674575b-dp5dl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-798674575b

SuccessfulCreate

Created pod: kube-auth-proxy-798674575b-cjnkz

openshift-ingress

replicaset-controller

kube-auth-proxy-798674575b

SuccessfulCreate

Created pod: kube-auth-proxy-798674575b-dp5dl

openshift-ingress

kubelet

kube-auth-proxy-798674575b-cjnkz

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-798674575b

FailedCreate

Error creating: pods "kube-auth-proxy-798674575b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-798674575b-cjnkz

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-798674575b-dp5dl

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-798674575b-dp5dl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-798674575b-cjnkz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-n7z45

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-798674575b-cjnkz

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-n7z45

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-798674575b-dp5dl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-798674575b-dp5dl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-798674575b-dp5dl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.621s (2.621s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-798674575b-cjnkz

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-798674575b-cjnkz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.494s (2.494s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.531s (2.531s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.719s (2.719s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdbzt6

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9kzn4

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-9kzn4

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9kzn4

Started

Started container discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-9kzn4

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9kzn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9kzn4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9kzn4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n7z45

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-n7z45

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-bh7f6

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-27xw5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-265v7

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-27xw5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-27xw5

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-265v7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-265v7

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-265v7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.333s (1.333s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-265v7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-27xw5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-27xw5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-27xw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.284s (1.284s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-265v7

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-bh7f6

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f002a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f002a1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-3a752f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-3a752f

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-9c9f1e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-9c9f1e

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-f002a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f002a1-openshift-default-6b669985db from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f002a1-openshift-default-6b669985db

SuccessfulCreate

Created pod: e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

openshift-ingress

multus

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-3a752f-openshift-default-7b87958d6d

SuccessfulCreate

Created pod: e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

openshift-ingress

deployment-controller

e2e-worker-w4-9c9f1e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-3a752f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a752f-openshift-default-7b87958d6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b

SuccessfulCreate

Created pod: e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

openshift-ingress

multus

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.857s (2.857s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-9c9f1e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9c9f1e: serviceaccount "payload-processing-e2e-worker-w4-9c9f1e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9c9f1e-785c744797

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9c9f1e-785c744797

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-9c9f1e-785c744797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9c9f1e: serviceaccount "payload-processing-e2e-worker-w4-9c9f1e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-9c9f1e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-9c9f1e-785c744797 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f002a1-8b996b58f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f002a1-8b996b58f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f002a1: serviceaccount "payload-processing-e2e-inf-a-f002a1" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f002a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f002a1-8b996b58f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f002a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f002a1: serviceaccount "payload-processing-e2e-inf-a-f002a1" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.782s (1.782s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f002a1-8b996b58f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-ab5750

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-ab5750

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 452ms (452ms including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.093s (1.093s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

e2e-autores-ab5750-openshift-default-55b755ff66

SuccessfulCreate

Created pod: e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

openshift-ingress

deployment-controller

e2e-autores-ab5750-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ab5750-openshift-default-55b755ff66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Started

Started container payload-processing

openshift-ingress

multus

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-1493ac87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1493ac87
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3a752f: serviceaccount "payload-processing-e2e-worker-w0-3a752f" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3a752f: serviceaccount "payload-processing-e2e-worker-w0-3a752f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-3a752f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-3a752f-776b9b9d9f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1493ac87-openshift-default-864ff78f7b

SuccessfulCreate

Created pod: e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

openshift-ingress

deployment-controller

e2e-ait-1493ac87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1493ac87-openshift-default-864ff78f7b from 0 to 1

openshift-ingress

multus

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-3a752f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ab5750: serviceaccount "payload-processing-e2e-autores-ab5750" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-ab5750

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-ab5750-5b6f7d747d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-ab5750

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-ab5750-6f8df94989 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ab5750-6f8df94989

SuccessfulCreate

Created pod: payload-processing-e2e-autores-ab5750-6f8df94989-kx65f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ab5750-6f8df94989

FailedCreate

Error creating: pods "payload-processing-e2e-autores-ab5750-6f8df94989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ab5750: serviceaccount "payload-processing-e2e-autores-ab5750" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1493ac87-76f8b7766c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1493ac87-76f8b7766c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1493ac87-76f8b7766c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1493ac87: serviceaccount "payload-processing-e2e-ait-1493ac87" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1493ac87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1493ac87-75c7f9845d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1493ac87: serviceaccount "payload-processing-e2e-ait-1493ac87" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1493ac87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1493ac87-76f8b7766c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-4eb26b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4eb26b-openshift-default-669575d694 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4eb26b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4eb26b

openshift-ingress

multus

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-4eb26b-openshift-default-669575d694

SuccessfulCreate

Created pod: e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj
(x7)

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4eb26b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4eb26b-76b85b788f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4eb26b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4eb26b-648878bc46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4eb26b: serviceaccount "payload-processing-e2e-inf-b-4eb26b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4eb26b-76b85b788f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4eb26b-76b85b788f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4eb26b: serviceaccount "payload-processing-e2e-inf-b-4eb26b" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4eb26b-76b85b788f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1493ac87-75c7f9845d-ltwk9

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1493ac87-76f8b7766c-jsj6z

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-d8a641aa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d8a641aa-gw

openshift-ingress

deployment-controller

e2e-migrate-d8a641aa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b from 0 to 1

openshift-ingress

kubelet

e2e-ait-1493ac87-openshift-default-864ff78f7b-vrldp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b

SuccessfulCreate

Created pod: e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5
(x2)

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d8a641aa: serviceaccount "payload-processing-e2e-migrate-d8a641aa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d8a641aa-8b7fd7458

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d8a641aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d8a641aa-8b7fd7458

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d8a641aa-8b7fd7458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d8a641aa: serviceaccount "payload-processing-e2e-migrate-d8a641aa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d8a641aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d8a641aa-8b7fd7458 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d8a641aa-57976ccd94-xw7m7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d8a641aa-8b7fd7458-n9d7q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-d8a641aa-gw-openshift-default-7fc8c44d7b-tqdd5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-65e77699

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-65e77699

openshift-ingress

deployment-controller

e2e-ait-65e77699-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-65e77699-openshift-default-9cd4966fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-65e77699-openshift-default-9cd4966fb

SuccessfulCreate

Created pod: e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

openshift-ingress

multus

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-65e77699

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-65e77699-7f54ddccc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-65e77699

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-65e77699-5cf59468c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-65e77699-5cf59468c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

openshift-ingress

multus

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-65e77699: serviceaccount "payload-processing-e2e-ait-65e77699" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

openshift-ingress

kubelet

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-65e77699-5cf59468c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-65e77699-5cf59468c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-65e77699: serviceaccount "payload-processing-e2e-ait-65e77699" not found
(x2)

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-65e77699-5cf59468c5-xcx4d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65e77699-7f54ddccc8-r78hn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-65e77699-openshift-default-9cd4966fb-d2lsm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-fb76f4c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-fb76f4c2-openshift-default-59b4dc47c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-fb76f4c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-fb76f4c2

openshift-ingress

replicaset-controller

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6

SuccessfulCreate

Created pod: e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

openshift-ingress

multus

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-fb76f4c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fb76f4c2: serviceaccount "payload-processing-e2e-derive-fb76f4c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-fb76f4c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fb76f4c2: serviceaccount "payload-processing-e2e-derive-fb76f4c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ab5750-5b6f7d747d-464xq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ab5750-6f8df94989-kx65f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fb76f4c2-6ddbc8bbd5-bm8lk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fb76f4c2-6cbd998d6-wppld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-fb76f4c2-openshift-default-59b4dc47c6-d2gtr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-8364a0-openshift-default-64568bf7d8

SuccessfulCreate

Created pod: e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

openshift-ingress

kubelet

e2e-autores-ab5750-openshift-default-55b755ff66-fr5ps

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-8364a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8364a0

openshift-ingress

deployment-controller

e2e-explicit-8364a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8364a0-openshift-default-64568bf7d8 from 0 to 1

openshift-ingress

multus

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8364a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8364a0-5f5d45748b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8364a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8364a0-7f467ccc8f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8364a0-7f467ccc8f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8364a0-7f467ccc8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8364a0: serviceaccount "payload-processing-e2e-explicit-8364a0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8364a0: serviceaccount "payload-processing-e2e-explicit-8364a0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8364a0-7f467ccc8f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

openshift-ingress

kubelet

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-446c5fbd-openshift-default-648f5bc69b

SuccessfulCreate

Created pod: e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

openshift-ingress

deployment-controller

e2e-mt-446c5fbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-446c5fbd-openshift-default-648f5bc69b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-446c5fbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-446c5fbd

openshift-ingress

GatewayAuthBootstrap

e2e-mt-446c5fbd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-446c5fbd-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-446c5fbd-authn-ssl" already exists

openshift-ingress

multus

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-446c5fbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-446c5fbd-775749b5c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-446c5fbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-446c5fbd-684c8685bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-446c5fbd-775749b5c7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-446c5fbd-775749b5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-446c5fbd: serviceaccount "payload-processing-e2e-mt-446c5fbd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-446c5fbd-775749b5c7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-446c5fbd: serviceaccount "payload-processing-e2e-mt-446c5fbd" not found

openshift-ingress

multus

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8364a0-5f5d45748b-tckmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8364a0-7f467ccc8f-cr8cd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-8364a0-openshift-default-64568bf7d8-4scqg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-f16030

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f16030

openshift-ingress

multus

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-noten-f16030-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f16030-openshift-default-699d768b48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-f16030-openshift-default-699d768b48

SuccessfulCreate

Created pod: e2e-noten-f16030-openshift-default-699d768b48-gqkcq

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-446c5fbd-684c8685bb-qm425

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-446c5fbd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-446c5fbd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-446c5fbd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-446c5fbd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e04d2476-d370-4377-b716-abef331f0aab, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-446c5fbd-775749b5c7-sv46m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-446c5fbd-openshift-default-648f5bc69b-x5s2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb

SuccessfulCreate

Created pod: e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

openshift-ingress

multus

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ce5b9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ce5b9b

openshift-ingress

deployment-controller

e2e-shared-a-w2-ce5b9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ce5b9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ce5b9b: serviceaccount "payload-processing-e2e-shared-a-w2-ce5b9b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ce5b9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ce5b9b: serviceaccount "payload-processing-e2e-shared-a-w2-ce5b9b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868

SuccessfulCreate

Created pod: e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-17d8b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-17d8b8

openshift-ingress

deployment-controller

e2e-shared-b-w2-17d8b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-17d8b8-openshift-default-6f74899868 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-17d8b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-17d8b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-17d8b8: serviceaccount "payload-processing-e2e-shared-b-w2-17d8b8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-17d8b8: serviceaccount "payload-processing-e2e-shared-b-w2-17d8b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f002a1-8b996b58f-f2rkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f002a1-7b4b649b54-wcxmx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-mt-12ecd131

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-12ecd131

openshift-ingress

deployment-controller

e2e-mt-12ecd131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-12ecd131-openshift-default-74fc8b59cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-12ecd131-openshift-default-74fc8b59cb

SuccessfulCreate

Created pod: e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

openshift-ingress

multus

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12ecd131-84b7fdbdc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-12ecd131-84b7fdbdc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12ecd131: serviceaccount "payload-processing-e2e-mt-12ecd131" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-12ecd131

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-12ecd131-7f655f44fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-12ecd131

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-12ecd131-84b7fdbdc7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

openshift-ingress

multus

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12ecd131: serviceaccount "payload-processing-e2e-mt-12ecd131" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12ecd131-84b7fdbdc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-f16030-openshift-default-699d768b48-gqkcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-f002a1-openshift-default-6b669985db-8v2pp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:54852->10.133.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:54852->10.133.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4eb26b-76b85b788f-hn58l

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4eb26b-648878bc46-7bsnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2b32aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2b32aa

openshift-ingress

deployment-controller

e2e-shared-a-w3-2b32aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4

SuccessfulCreate

Created pod: e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

openshift-ingress

multus

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-4eb26b-openshift-default-669575d694-vmqnj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2b32aa: serviceaccount "payload-processing-e2e-shared-a-w3-2b32aa" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2b32aa: serviceaccount "payload-processing-e2e-shared-a-w3-2b32aa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2b32aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2b32aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-177593-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-177593-openshift-default-75f8f59f54 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-177593-openshift-default-75f8f59f54

SuccessfulCreate

Created pod: e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-177593

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-177593
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-177593: serviceaccount "payload-processing-e2e-shared-b-w3-177593" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-177593

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-177593: serviceaccount "payload-processing-e2e-shared-b-w3-177593" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-177593

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12ecd131-7f655f44fd-cm47f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12ecd131-84b7fdbdc7-qtf4w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-12ecd131-openshift-default-74fc8b59cb-ns82w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-3a33c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3a33c1-openshift-default-5bfb98f9cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-3a33c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3a33c1

openshift-ingress

replicaset-controller

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb

SuccessfulCreate

Created pod: e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

openshift-ingress

multus

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3a33c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a33c1: serviceaccount "payload-processing-e2e-api-a-3a33c1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a33c1: serviceaccount "payload-processing-e2e-api-a-3a33c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3a33c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3a33c1-8f9b5d4d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-97da78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-97da78

openshift-ingress

deployment-controller

e2e-api-b-97da78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-97da78-openshift-default-6bb96878c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-97da78-openshift-default-6bb96878c4

SuccessfulCreate

Created pod: e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

openshift-ingress

multus

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-97da78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-97da78-85857b5bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-97da78-85857b5bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-97da78-85857b5bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-97da78: serviceaccount "payload-processing-e2e-api-b-97da78" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-97da78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-97da78-75ffd978bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-97da78-85857b5bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-97da78-75ffd978bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-97da78-75ffd978bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-97da78-75ffd978bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-97da78: serviceaccount "payload-processing-e2e-api-b-97da78" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a752f-776b9b9d9f-42gsk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a752f-69bdf4d6b-gl7qz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-3a752f-openshift-default-7b87958d6d-lxzrk

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-3a33c1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-3a33c1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-3a33c1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-3a33c1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5c95128a-6034-4776-a221-b427e1d3d84a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a33c1-8f9b5d4d7-jwbkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a33c1-58cdf544cd-v2xw4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-3a33c1-openshift-default-5bfb98f9cb-9hfww

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-97da78

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-97da78: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-97da78": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-97da78, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 271fc6e4-9af6-4168-a683-bdd19b078a6b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-97da78-85857b5bf-r5b5d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97da78-75ffd978bb-9hd95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-97da78-openshift-default-6bb96878c4-wgvrh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ce5b9b-8f77c865d-d2qkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ce5b9b-fbc675bc7-xz9br

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-ce5b9b-openshift-default-6cf7cf5bbb-mdmw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9c9f1e-785c744797-7hjth

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9c9f1e-5585495d58-nqmhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-17d8b8-6cd4f6d65d-dmzrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-17d8b8-794c9b7f47-pkr5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-9c9f1e-openshift-default-5cd9c7f58b-qw4qs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-17d8b8-openshift-default-6f74899868-d29rk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-d081a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d081a3-openshift-default-7d588845bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d081a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d081a3

openshift-ingress

replicaset-controller

e2e-ipp-a-d081a3-openshift-default-7d588845bd

SuccessfulCreate

Created pod: e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

openshift-ingress

multus

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d081a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d081a3-5df4dd896c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d081a3: serviceaccount "payload-processing-e2e-ipp-a-d081a3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d081a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d081a3-57475879d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d081a3-5df4dd896c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d081a3-5df4dd896c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d081a3-5df4dd896c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d081a3: serviceaccount "payload-processing-e2e-ipp-a-d081a3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": read tcp 10.132.0.2:33040->10.132.0.91:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": read tcp 10.132.0.2:33040->10.132.0.91:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8d29d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8d29d7

openshift-ingress

deployment-controller

e2e-ipp-b-8d29d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8d29d7-openshift-default-556cb546d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8d29d7-openshift-default-556cb546d4

SuccessfulCreate

Created pod: e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

openshift-ingress

multus

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8d29d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8d29d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8d29d7: serviceaccount "payload-processing-e2e-ipp-b-8d29d7" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8d29d7: serviceaccount "payload-processing-e2e-ipp-b-8d29d7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3b049b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3b049b

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3b049b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3b049b-openshift-default-d97f57556 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

openshift-ingress

multus

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3b049b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3b049b-64f997666c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3b049b: serviceaccount "payload-processing-e2e-ipp-cleanup-3b049b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3b049b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3b049b: serviceaccount "payload-processing-e2e-ipp-cleanup-3b049b" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3b049b-64f997666c-h22nf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3b049b-fb696d594-q5x8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3b049b-openshift-default-d97f57556-cgdgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d081a3-5df4dd896c-dc97l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d081a3-57475879d6-j954c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d081a3-openshift-default-7d588845bd-fjfxh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d29d7-5896fdfbdc-v2trc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d29d7-548dddc64b-5tr2f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8d29d7-openshift-default-556cb546d4-dzwhg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b32aa-5959d5bf89-hbzbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b32aa-7d7c8cddcd-crjgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-2b32aa-openshift-default-7bd57545c4-l5dfm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-177593-6c4bf64dcc-2t8c9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-177593-b77c9949d-8gtv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-177593-openshift-default-75f8f59f54-z6x5t

Killing

Stopping container istio-proxy