Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-5b54b7fbb7-zdsqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zdsqr to ip-10-0-137-43.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5 to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb to ip-10-0-142-52.ec2.internal

openshift-ingress

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk to ip-10-0-132-25.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-kt4pd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-kt4pd to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7 to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2 to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6 to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn to ip-10-0-137-43.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-sxqmr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxqmr to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-tscfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-tscfp to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2 to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8 to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4 to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z to ip-10-0-142-52.ec2.internal

openshift-ingress

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4 to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st to ip-10-0-142-52.ec2.internal

openshift-ingress

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-inf-b-e39762-openshift-default

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.189.213 is not allocated; repairing

openshift-ingress

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw to ip-10-0-142-52.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6k5qw to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg to ip-10-0-132-25.ec2.internal

openshift-ingress

router-default-88497859b-8nkdj

Scheduled

Successfully assigned openshift-ingress/router-default-88497859b-8nkdj to ip-10-0-137-43.ec2.internal

openshift-ingress

router-default-88497859b-8nkdj

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4 to ip-10-0-132-25.ec2.internal

openshift-ingress

kube-auth-proxy-7d44f46d57-r2s76

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d44f46d57-r2s76 to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4 to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl to ip-10-0-137-43.ec2.internal

openshift-ingress

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-8debe9-openshift-default-796d556b76-6jlnz to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc to ip-10-0-142-52.ec2.internal

openshift-ingress

kube-auth-proxy-7d44f46d57-7dn5g

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d44f46d57-7dn5g to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8 to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm to ip-10-0-137-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7 to ip-10-0-142-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd to ip-10-0-142-52.ec2.internal

openshift-ingress

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd to ip-10-0-132-25.ec2.internal

openshift-ingress

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h to ip-10-0-132-25.ec2.internal

openshift-ingress

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp to ip-10-0-137-43.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-88497859b from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-88497859b

FailedCreate

Error creating: pods "router-default-88497859b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-88497859b

FailedCreate

Error creating: pods "router-default-88497859b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-88497859b

SuccessfulCreate

Created pod: router-default-88497859b-8nkdj
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-88497859b-8nkdj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-88497859b-8nkdj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-88497859b-8nkdj

Started

Started container router

openshift-ingress

kubelet

router-default-88497859b-8nkdj

Created

Created container: router

openshift-ingress

kubelet

router-default-88497859b-8nkdj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-88497859b-8nkdj

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d44f46d57 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44f46d57

SuccessfulCreate

Created pod: kube-auth-proxy-7d44f46d57-r2s76
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44f46d57

FailedCreate

Error creating: pods "kube-auth-proxy-7d44f46d57-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44f46d57

SuccessfulCreate

Created pod: kube-auth-proxy-7d44f46d57-7dn5g

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-7dn5g

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d44f46d57-7dn5g

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-r2s76

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d44f46d57-r2s76

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-sxqmr

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-sxqmr

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-7dn5g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.626s (2.626s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-7dn5g

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-7dn5g

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-r2s76

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-r2s76

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.706s (3.706s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d44f46d57-r2s76

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.153s (5.153s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.851s (2.851s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cc2p4j

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-kt4pd

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-kt4pd

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kt4pd

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kt4pd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kt4pd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kt4pd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kt4pd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxqmr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-sxqmr

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-6k5qw

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.641s (2.641s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-tscfp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zdsqr

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tscfp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-zdsqr

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-tscfp

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdsqr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tscfp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdsqr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.71s (2.71s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tscfp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.731s (2.731s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tscfp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdsqr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdsqr

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Unhealthy

Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

ProbeError

Readiness probe error: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-6k5qw

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-34fed8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-34fed8

openshift-ingress

deployment-controller

e2e-inf-a-34fed8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-34fed8-openshift-default-7746975b7d from 0 to 1

openshift-ingress

multus

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-34fed8-openshift-default-7746975b7d

SuccessfulCreate

Created pod: e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-34fed8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-34fed8-86df68cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-34fed8-86df68cc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-34fed8-86df68cc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-34fed8-86df68cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-34fed8: serviceaccount "payload-processing-e2e-inf-a-34fed8" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-34fed8: serviceaccount "payload-processing-e2e-inf-a-34fed8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-34fed8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-8debe9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-8debe9

openshift-ingress

deployment-controller

e2e-autores-8debe9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-8debe9-openshift-default-796d556b76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-8debe9-openshift-default-796d556b76

SuccessfulCreate

Created pod: e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

openshift-ingress

multus

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-425c6986

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-425c6986

openshift-ingress

deployment-controller

e2e-ait-425c6986-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-425c6986-openshift-default-5674bb7d7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-425c6986-openshift-default-5674bb7d7d

SuccessfulCreate

Created pod: e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

openshift-ingress

multus

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8debe9-564758bcbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-8debe9-564758bcbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8debe9: serviceaccount "payload-processing-e2e-autores-8debe9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8debe9-75576b4b59

SuccessfulCreate

Created pod: payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

openshift-ingress

deployment-controller

payload-processing-e2e-autores-8debe9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-8debe9-75576b4b59 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8debe9-75576b4b59

FailedCreate

Error creating: pods "payload-processing-e2e-autores-8debe9-75576b4b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8debe9: serviceaccount "payload-processing-e2e-autores-8debe9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8debe9-564758bcbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-8debe9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-8debe9-564758bcbb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.759s (1.759s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-425c6986

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-425c6986-6f765bd8b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-425c6986: serviceaccount "payload-processing-e2e-ait-425c6986" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-425c6986

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-425c6986-7675dd4749 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-425c6986-7675dd4749

FailedCreate

Error creating: pods "payload-processing-e2e-ait-425c6986-7675dd4749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-425c6986: serviceaccount "payload-processing-e2e-ait-425c6986" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-425c6986-7675dd4749

SuccessfulCreate

Created pod: payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

openshift-ingress

multus

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

openshift-ingress

kubelet

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 5.389s (5.389s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e39762

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e39762

openshift-ingress

multus

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-e39762-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e39762-openshift-default-7b5dc6bbd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4

SuccessfulCreate

Created pod: e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg
(x5)

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e39762-6bd48d4dc9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e39762: serviceaccount "payload-processing-e2e-inf-b-e39762" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e39762

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e39762-544ddb47d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e39762

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e39762-6bd48d4dc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e39762-6bd48d4dc9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e39762-6bd48d4dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e39762: serviceaccount "payload-processing-e2e-inf-b-e39762" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

Created

Created container: payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-425c6986

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-425c6986: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-425c6986": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-425c6986, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4da3114e-ba25-4434-a455-5c0996fc654d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-425c6986-6f765bd8b6-l62lp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-425c6986-7675dd4749-4gjkp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-425c6986-openshift-default-5674bb7d7d-wztrk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-96c53ecc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb

SuccessfulCreate

Created pod: e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

openshift-ingress

gateway_labeler_controller

e2e-migrate-96c53ecc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-96c53ecc-gw

openshift-ingress

multus

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-96c53ecc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-96c53ecc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-96c53ecc-6c96f9cf98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-96c53ecc: serviceaccount "payload-processing-e2e-migrate-96c53ecc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-96c53ecc: serviceaccount "payload-processing-e2e-migrate-96c53ecc" not found
(x2)

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-96c53ecc-f7cbb5878-m9qgs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-96c53ecc-6c96f9cf98-rlfjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-96c53ecc-gw-openshift-default-54b546cfb-xkxv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-8debe9-75576b4b59-f8lfs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8debe9-564758bcbb-ng7gn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-f86ebb1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f86ebb1f

openshift-ingress

deployment-controller

e2e-ait-f86ebb1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4

SuccessfulCreate

Created pod: e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

openshift-ingress

multus

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f86ebb1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f86ebb1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f86ebb1f-57dd4779ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f86ebb1f-57dd4779ff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f86ebb1f-57dd4779ff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f86ebb1f-57dd4779ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f86ebb1f: serviceaccount "payload-processing-e2e-ait-f86ebb1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f86ebb1f: serviceaccount "payload-processing-e2e-ait-f86ebb1f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-explicit-356350-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-356350-openshift-default-85f8787bb8 from 0 to 1

openshift-ingress

kubelet

e2e-autores-8debe9-openshift-default-796d556b76-6jlnz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-356350-openshift-default-85f8787bb8

SuccessfulCreate

Created pod: e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

openshift-ingress

gateway_labeler_controller

e2e-explicit-356350

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-356350

openshift-ingress

multus

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-356350-68f8957d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-356350-68f8957d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-356350: serviceaccount "payload-processing-e2e-explicit-356350" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-356350-55598b5b7c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-356350-68f8957d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-356350

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-356350-68f8957d7d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-356350-55598b5b7c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-356350-55598b5b7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-356350: serviceaccount "payload-processing-e2e-explicit-356350" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-356350

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-356350-55598b5b7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f86ebb1f-7bf5769dd6-fcnbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f86ebb1f-57dd4779ff-xzzch

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f86ebb1f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f86ebb1f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f86ebb1f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f86ebb1f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0e2797ce-b7cc-48f4-92a1-fdcb835f750e, UID in object meta:

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-4f2c6181-openshift-default-857b89c7d8

SuccessfulCreate

Created pod: e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

openshift-ingress

multus

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-4f2c6181

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4f2c6181

openshift-ingress

deployment-controller

e2e-derive-4f2c6181-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4f2c6181-openshift-default-857b89c7d8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f86ebb1f-openshift-default-5c85dd5cb4-nsvkg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4f2c6181

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4f2c6181-74446684cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4f2c6181

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4f2c6181-75fc747fbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4f2c6181-74446684cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4f2c6181-75fc747fbf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

openshift-ingress

kubelet

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4f2c6181-74446684cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4f2c6181-74446684cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4f2c6181: serviceaccount "payload-processing-e2e-derive-4f2c6181" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4f2c6181-75fc747fbf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4f2c6181-75fc747fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4f2c6181: serviceaccount "payload-processing-e2e-derive-4f2c6181" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-4f2c6181-75fc747fbf-gbb76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-4f2c6181-openshift-default-857b89c7d8-56g9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4f2c6181-74446684cd-wn2rm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-356350-68f8957d7d-btdb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-356350-55598b5b7c-s4n5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-356350-openshift-default-85f8787bb8-x4jmt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-86d73c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-86d73c-openshift-default-7996c4b59d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-86d73c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-86d73c

openshift-ingress

replicaset-controller

e2e-noten-86d73c-openshift-default-7996c4b59d

SuccessfulCreate

Created pod: e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

openshift-ingress

kubelet

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-86d73c-openshift-default-7996c4b59d-s64z4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-9fbfa439

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9fbfa439

openshift-ingress

replicaset-controller

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8

SuccessfulCreate

Created pod: e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

openshift-ingress

deployment-controller

e2e-mt-9fbfa439-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9fbfa439-openshift-default-6bfc67ffd8 from 0 to 1

openshift-ingress

multus

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9fbfa439: serviceaccount "payload-processing-e2e-mt-9fbfa439" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9fbfa439

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9fbfa439

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9fbfa439-67856bdc45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9fbfa439-67856bdc45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9fbfa439-67856bdc45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9fbfa439-67856bdc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9fbfa439: serviceaccount "payload-processing-e2e-mt-9fbfa439" not found

openshift-ingress

multus

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34fed8-86df68cc-97nxl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34fed8-76d7f7cb94-qd7rb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-34fed8-openshift-default-7746975b7d-4knw4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e39762-544ddb47d6-f9kw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e39762-6bd48d4dc9-ldpjw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e39762-openshift-default-7b5dc6bbd4-kbtcg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-9ca1fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9ca1fc

openshift-ingress

replicaset-controller

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74

SuccessfulCreate

Created pod: e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

openshift-ingress

multus

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-9ca1fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9fbfa439-54b7d957fd-h4bvc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9fbfa439-67856bdc45-2n77r

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ca1fc: serviceaccount "payload-processing-e2e-shared-a-w3-9ca1fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-9ca1fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-9ca1fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ca1fc: serviceaccount "payload-processing-e2e-shared-a-w3-9ca1fc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-9fbfa439-openshift-default-6bfc67ffd8-xrgv4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:53264->10.133.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:53264->10.133.0.51:15021: read: connection reset by peer

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-03e8df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-03e8df

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-03e8df

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-03e8df-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-03e8df-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-shared-a-w2-03e8df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-03e8df-openshift-default-cff645bf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4

SuccessfulCreate

Created pod: e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

openshift-ingress

multus

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-9fb31f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9fb31f-openshift-default-66789ff844 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844

SuccessfulCreate

Created pod: e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-03e8df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-9fb31f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-9fb31f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-03e8df: serviceaccount "payload-processing-e2e-shared-a-w2-03e8df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-03e8df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-03e8df: serviceaccount "payload-processing-e2e-shared-a-w2-03e8df" not found

openshift-ingress

multus

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-9fb31f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-9fb31f-67794c679f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-9fb31f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9fb31f: serviceaccount "payload-processing-e2e-shared-b-w3-9fb31f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9fb31f: serviceaccount "payload-processing-e2e-shared-b-w3-9fb31f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-a7ae4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a7ae4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a7ae4e

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-a7ae4e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-a7ae4e-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-a7ae4e-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a7ae4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a7ae4e: serviceaccount "payload-processing-e2e-shared-b-w2-a7ae4e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a7ae4e: serviceaccount "payload-processing-e2e-shared-b-w2-a7ae4e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a7ae4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-4e499427-openshift-default-68475d96bd

SuccessfulCreate

Created pod: e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

openshift-ingress

deployment-controller

e2e-mt-4e499427-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4e499427-openshift-default-68475d96bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4e499427

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4e499427

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4e499427-6ff66f6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4e499427

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4e499427-6ff66f6db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4e499427-58b69954cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4e499427-58b69954cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4e499427-58b69954cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4e499427: serviceaccount "payload-processing-e2e-mt-4e499427" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4e499427-6ff66f6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4e499427-6ff66f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4e499427: serviceaccount "payload-processing-e2e-mt-4e499427" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4e499427

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4e499427-58b69954cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-4e499427-58b69954cc-8lxgx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4e499427-6ff66f6db-f4nrs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4e499427-openshift-default-68475d96bd-jxk9g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-630e4d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-630e4d

openshift-ingress

deployment-controller

e2e-api-a-630e4d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-630e4d-openshift-default-7565fc8df6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-630e4d-openshift-default-7565fc8df6

SuccessfulCreate

Created pod: e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

openshift-ingress

multus

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-630e4d: serviceaccount "payload-processing-e2e-api-a-630e4d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-630e4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-630e4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-630e4d-55c84cdff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-630e4d-55c84cdff

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-630e4d-55c84cdff

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-630e4d-55c84cdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-630e4d: serviceaccount "payload-processing-e2e-api-a-630e4d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

openshift-ingress

multus

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-bea11f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-bea11f-openshift-default-7d9bbd8f46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-bea11f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bea11f

openshift-ingress

replicaset-controller

e2e-api-b-bea11f-openshift-default-7d9bbd8f46

SuccessfulCreate

Created pod: e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

openshift-ingress

multus

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-bea11f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-bea11f-f5cfd79b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bea11f-f5cfd79b5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-bea11f-f5cfd79b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bea11f: serviceaccount "payload-processing-e2e-api-b-bea11f" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-bea11f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-bea11f-bf956d5f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bea11f-f5cfd79b5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

openshift-ingress

multus

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bea11f: serviceaccount "payload-processing-e2e-api-b-bea11f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb
(x2)

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-630e4d-55c84cdff-bgwb7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-630e4d-7bcc585c8b-xt7g7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-630e4d-openshift-default-7565fc8df6-hgmtt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-bea11f-f5cfd79b5-trzz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bea11f-bf956d5f8-qwcjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-bea11f-openshift-default-7d9bbd8f46-cgr4c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-03e8df-57b9f4d96f-28h5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-03e8df-675bdf66c4-qnfd8

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-03e8df

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-03e8df: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-03e8df": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-03e8df, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2b93e7e9-526f-43f7-9da6-bbb31094d38c, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-03e8df-openshift-default-cff645bf4-9spkd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a7ae4e-6c6475c99c-xswv8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a7ae4e-6865bd549d-g8cm7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a7ae4e-openshift-default-854df7cdbb-55bg6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-41de51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-41de51

openshift-ingress

multus

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-41de51-openshift-default-64bb5f585d

SuccessfulCreate

Created pod: e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

openshift-ingress

deployment-controller

e2e-ipp-a-41de51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-41de51-openshift-default-64bb5f585d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-41de51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-41de51-5d7bb4d857 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-41de51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-41de51-7bb747454b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41de51: serviceaccount "payload-processing-e2e-ipp-a-41de51" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41de51-5d7bb4d857

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-41de51-5d7bb4d857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41de51: serviceaccount "payload-processing-e2e-ipp-a-41de51" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41de51-5d7bb4d857

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": read tcp 10.134.0.2:57092->10.134.0.85:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": read tcp 10.134.0.2:57092->10.134.0.85:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-0fea02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0fea02-openshift-default-56db88bb5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0fea02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0fea02

openshift-ingress

multus

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-0fea02-openshift-default-56db88bb5b

SuccessfulCreate

Created pod: e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

openshift-ingress

multus

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0fea02-65589b7d8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0fea02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0fea02-65589b7d8c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0fea02: serviceaccount "payload-processing-e2e-ipp-b-0fea02" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0fea02-65589b7d8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0fea02-65589b7d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0fea02: serviceaccount "payload-processing-e2e-ipp-b-0fea02" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0fea02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-21c704

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-21c704

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74

SuccessfulCreate

Created pod: e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

openshift-ingress

multus

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-21c704-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-21c704-openshift-default-b6875fd74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-21c704: serviceaccount "payload-processing-e2e-ipp-cleanup-21c704" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-21c704

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-21c704-555755764f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-21c704-555755764f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-21c704-555755764f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-21c704: serviceaccount "payload-processing-e2e-ipp-cleanup-21c704" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-21c704

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-21c704-555755764f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-21c704-84f75dcf58-pgf2x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-21c704-555755764f-jckq7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-21c704-openshift-default-b6875fd74-sjlq2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41de51-5d7bb4d857-lb9cs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41de51-7bb747454b-v45st

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-41de51-openshift-default-64bb5f585d-2grcw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0fea02-6d7b9b49f8-cfbtd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0fea02-65589b7d8c-xtjmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-0fea02-openshift-default-56db88bb5b-5bzw4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9ca1fc-765b6ffdfc-m4nrf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9ca1fc-967f9c89d-xwfvm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-9ca1fc-openshift-default-688754cc74-7nh7z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9fb31f-67794c679f-9jsr4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9fb31f-754f6485d-j2lsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-9fb31f-openshift-default-66789ff844-dmf4r

Killing

Stopping container istio-proxy