Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9 to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 to ip-10-0-142-20.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8066138e-64d98946df-lxb7n to ip-10-0-137-6.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7 to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-frbc8

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-frbc8 to ip-10-0-142-20.ec2.internal

openshift-ingress

kube-auth-proxy-6dd8bb6964-pskvx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6dd8bb6964-pskvx to ip-10-0-137-6.ec2.internal

openshift-ingress

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 to ip-10-0-142-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss to ip-10-0-137-6.ec2.internal

openshift-ingress

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4 to ip-10-0-137-6.ec2.internal

openshift-ingress

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Scheduled

Successfully assigned openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 to ip-10-0-142-20.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5 to ip-10-0-137-6.ec2.internal

openshift-ingress

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5 to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj to ip-10-0-129-248.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cf4k2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2 to ip-10-0-142-20.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8 to ip-10-0-137-6.ec2.internal

openshift-ingress

router-default-65fd4f6866-nr2wr

Scheduled

Successfully assigned openshift-ingress/router-default-65fd4f6866-nr2wr to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7 to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw to ip-10-0-137-6.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-r7pgn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn to ip-10-0-129-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4 to ip-10-0-137-6.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-558h6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-558h6 to ip-10-0-137-6.ec2.internal

openshift-ingress

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Scheduled

Successfully assigned openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 to ip-10-0-129-248.ec2.internal

openshift-ingress

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd to ip-10-0-142-20.ec2.internal

openshift-ingress

kube-auth-proxy-6dd8bb6964-vtpjp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp to ip-10-0-142-20.ec2.internal

openshift-ingress

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst to ip-10-0-142-20.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9 to ip-10-0-129-248.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 to ip-10-0-129-248.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-65fd4f6866 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-65fd4f6866

FailedCreate

Error creating: pods "router-default-65fd4f6866-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-65fd4f6866

FailedCreate

Error creating: pods "router-default-65fd4f6866-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-65fd4f6866

SuccessfulCreate

Created pod: router-default-65fd4f6866-nr2wr
(x6)

openshift-ingress

kubelet

router-default-65fd4f6866-nr2wr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-65fd4f6866-nr2wr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-65fd4f6866-nr2wr

Started

Started container router

openshift-ingress

kubelet

router-default-65fd4f6866-nr2wr

Created

Created container: router

openshift-ingress

kubelet

router-default-65fd4f6866-nr2wr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-65fd4f6866-nr2wr

AddedInterface

Add eth0 [10.133.0.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6dd8bb6964 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-6dd8bb6964-vtpjp

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6dd8bb6964-pskvx

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-6dd8bb6964

SuccessfulCreate

Created pod: kube-auth-proxy-6dd8bb6964-pskvx

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-vtpjp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-6dd8bb6964

SuccessfulCreate

Created pod: kube-auth-proxy-6dd8bb6964-vtpjp

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-pskvx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-6dd8bb6964

FailedCreate

Error creating: pods "kube-auth-proxy-6dd8bb6964-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cf4k2

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cf4k2

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-vtpjp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-pskvx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.677s (2.677s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-pskvx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-pskvx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-vtpjp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.793s (2.793s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6dd8bb6964-vtpjp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.061s (3.061s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.723s (3.723s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-r7pgn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7pgn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-r7pgn

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7pgn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7pgn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7pgn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.358s (3.358s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cf4k2

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cf4k2
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-mm2f9

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-frbc8

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-558h6

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-558h6

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-558h6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-frbc8

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-frbc8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-frbc8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.062s (2.062s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-558h6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-558h6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.685s (1.685s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-558h6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-frbc8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-frbc8

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-mm2f9

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-798a5d-openshift-default-6c55bdf478

SuccessfulCreate

Created pod: e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

openshift-ingress

gateway_labeler_controller

e2e-inf-a-798a5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-798a5d

openshift-ingress

deployment-controller

e2e-inf-a-798a5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-798a5d-openshift-default-6c55bdf478 from 0 to 1

openshift-ingress

multus

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-798a5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-798a5d-7748cb9885 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-798a5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-798a5d: serviceaccount "payload-processing-e2e-inf-a-798a5d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-798a5d-7748cb9885

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-798a5d-7748cb9885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-798a5d: serviceaccount "payload-processing-e2e-inf-a-798a5d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-798a5d-7748cb9885

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

openshift-ingress

multus

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-3af37e0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3af37e0c

openshift-ingress

GatewayAuthBootstrap

e2e-ait-3af37e0c

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-3af37e0c-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-3af37e0c-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-ait-3af37e0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3af37e0c-openshift-default-648c9fc768 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3af37e0c-openshift-default-648c9fc768

SuccessfulCreate

Created pod: e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

openshift-ingress

gateway_labeler_controller

e2e-autores-71518b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-71518b

openshift-ingress

deployment-controller

e2e-autores-71518b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-71518b-openshift-default-796cf4cc46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-71518b-openshift-default-796cf4cc46

SuccessfulCreate

Created pod: e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

openshift-ingress

multus

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3af37e0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3af37e0c-7dd85d9d6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3af37e0c: serviceaccount "payload-processing-e2e-ait-3af37e0c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3af37e0c: serviceaccount "payload-processing-e2e-ait-3af37e0c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3af37e0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3af37e0c-68d48ff86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

openshift-ingress

kubelet

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

openshift-ingress

kubelet

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-71518b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-71518b-579b68988f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71518b-579b68988f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-71518b-579b68988f-9gdtb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71518b-579b68988f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-71518b-579b68988f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71518b: serviceaccount "payload-processing-e2e-autores-71518b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71518b-7c457df46b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71518b-7c457df46b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-71518b-7c457df46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71518b: serviceaccount "payload-processing-e2e-autores-71518b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-71518b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-71518b-7c457df46b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.439s (3.439s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": read tcp 10.134.0.2:37410->10.134.0.34:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": read tcp 10.134.0.2:37410->10.134.0.34:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-02a199-openshift-default-77fc5ffd9b

SuccessfulCreate

Created pod: e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

openshift-ingress

deployment-controller

e2e-inf-b-02a199-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-02a199-openshift-default-77fc5ffd9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-02a199

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-02a199
(x5)

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02a199-5878dccff5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-02a199-5878dccff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02a199: serviceaccount "payload-processing-e2e-inf-b-02a199" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-02a199

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-02a199-574d6668d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02a199-574d6668d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-02a199-574d6668d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02a199: serviceaccount "payload-processing-e2e-inf-b-02a199" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02a199-574d6668d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

openshift-ingress

multus

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02a199-5878dccff5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9
(x2)

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-02a199

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-02a199-5878dccff5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3af37e0c-68d48ff86-d7dt4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3af37e0c-7dd85d9d6c-gjjk5

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-3af37e0c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-3af37e0c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-3af37e0c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-3af37e0c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2fb1c448-5885-4592-950e-0ffee82eaddb, UID in object meta:

openshift-ingress

replicaset-controller

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd

SuccessfulCreate

Created pod: e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

openshift-ingress

gateway_labeler_controller

e2e-migrate-8ac49eaa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8ac49eaa-gw

openshift-ingress

deployment-controller

e2e-migrate-8ac49eaa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd from 0 to 1

openshift-ingress

multus

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.731s (2.731s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8ac49eaa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8ac49eaa-c585cfb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8ac49eaa: serviceaccount "payload-processing-e2e-migrate-8ac49eaa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8ac49eaa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8ac49eaa-c585cfb6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8ac49eaa-c585cfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8ac49eaa: serviceaccount "payload-processing-e2e-migrate-8ac49eaa" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8ac49eaa-c585cfb6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

openshift-ingress

multus

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8ac49eaa-fd97fd6f8-vpj8c

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-8066138e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8066138e

openshift-ingress

kubelet

e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8066138e-openshift-default-7bcd9974b6

SuccessfulCreate

Created pod: e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

openshift-ingress

deployment-controller

e2e-ait-8066138e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8066138e-openshift-default-7bcd9974b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8066138e-64d98946df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8066138e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8066138e-64d98946df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8066138e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8066138e-c5f96fbfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8066138e-64d98946df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8066138e-64d98946df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8066138e: serviceaccount "payload-processing-e2e-ait-8066138e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8066138e: serviceaccount "payload-processing-e2e-ait-8066138e" not found

openshift-ingress

multus

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-8066138e-64d98946df-lxb7n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-02cfd933-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-02cfd933-openshift-default-5c5b486d44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-02cfd933

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-02cfd933

openshift-ingress

replicaset-controller

e2e-derive-02cfd933-openshift-default-5c5b486d44

SuccessfulCreate

Created pod: e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

openshift-ingress

multus

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71518b-579b68988f-9gdtb

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-02cfd933-689f7776c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-02cfd933-689f7776c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02cfd933: serviceaccount "payload-processing-e2e-derive-02cfd933" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-02cfd933-689f7776c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-02cfd933

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-02cfd933-689f7776c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-02cfd933

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-02cfd933-7c5d5ffd77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-02cfd933-7c5d5ffd77

FailedCreate

Error creating: pods "payload-processing-e2e-derive-02cfd933-7c5d5ffd77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02cfd933: serviceaccount "payload-processing-e2e-derive-02cfd933" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-02cfd933-7c5d5ffd77

SuccessfulCreate

Created pod: payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

openshift-ingress

kubelet

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-222cd5-openshift-default-9764c596

SuccessfulCreate

Created pod: e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

openshift-ingress

deployment-controller

e2e-explicit-222cd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-222cd5-openshift-default-9764c596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-222cd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-222cd5

openshift-ingress

multus

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-71518b-openshift-default-796cf4cc46-jcq88

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-222cd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-222cd5-dbd5dd9f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-222cd5-dbd5dd9f7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-222cd5-dbd5dd9f7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-222cd5-dbd5dd9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-222cd5: serviceaccount "payload-processing-e2e-explicit-222cd5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-222cd5: serviceaccount "payload-processing-e2e-explicit-222cd5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-222cd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:37528->10.132.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:37528->10.132.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-222cd5-65db8c7cdb-7pp7n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-222cd5-openshift-default-9764c596-x2rrd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-f020ee-openshift-default-6689d54d88

SuccessfulCreate

Created pod: e2e-noten-f020ee-openshift-default-6689d54d88-967h9

openshift-ingress

gateway_labeler_controller

e2e-noten-f020ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f020ee

openshift-ingress

deployment-controller

e2e-noten-f020ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f020ee-openshift-default-6689d54d88 from 0 to 1

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-f020ee-openshift-default-6689d54d88-967h9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-mt-653c2a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-653c2a83-openshift-default-858787d556 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-798a5d-7748cb9885-rrdkw

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-653c2a83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-653c2a83

openshift-ingress

replicaset-controller

e2e-mt-653c2a83-openshift-default-858787d556

SuccessfulCreate

Created pod: e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-798a5d-84f79d4cc4-xcdwr

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-653c2a83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-653c2a83-5d6cbc77bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-653c2a83-5d6cbc77bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-653c2a83: serviceaccount "payload-processing-e2e-mt-653c2a83" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-653c2a83-5d6cbc77bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-653c2a83-5d6cbc77bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-653c2a83: serviceaccount "payload-processing-e2e-mt-653c2a83" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-653c2a83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02a199-574d6668d6-j8rm5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w3-ef8f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ef8f61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ef8f61

openshift-ingress

multus

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648

SuccessfulCreate

Created pod: e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61: serviceaccount "payload-processing-e2e-shared-a-w3-ef8f61" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ef8f61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61: serviceaccount "payload-processing-e2e-shared-a-w3-ef8f61" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ef8f61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f83533

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f83533

openshift-ingress

deployment-controller

e2e-shared-b-w3-f83533-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f83533-openshift-default-549c4bcb58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58

SuccessfulCreate

Created pod: e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

openshift-ingress

multus

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-653c2a83-openshift-default-858787d556-kcjp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f83533: serviceaccount "payload-processing-e2e-shared-b-w3-f83533" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f83533

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f83533

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f83533-56d6979ccc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f83533: serviceaccount "payload-processing-e2e-shared-b-w3-f83533" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-11dfb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-11dfb4

openshift-ingress

deployment-controller

e2e-shared-a-w2-11dfb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-11dfb4-openshift-default-595695669d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-11dfb4-openshift-default-595695669d

SuccessfulCreate

Created pod: e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

openshift-ingress

multus

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-11dfb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-11dfb4: serviceaccount "payload-processing-e2e-shared-a-w2-11dfb4" not found

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-11dfb4: serviceaccount "payload-processing-e2e-shared-a-w2-11dfb4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-11dfb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f8c7bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f8c7bd

openshift-ingress

deployment-controller

e2e-shared-b-w2-f8c7bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d

SuccessfulCreate

Created pod: e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

openshift-ingress

multus

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f8c7bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd: serviceaccount "payload-processing-e2e-shared-b-w2-f8c7bd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd: serviceaccount "payload-processing-e2e-shared-b-w2-f8c7bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f8c7bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8

SuccessfulCreate

Created pod: e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

openshift-ingress

deployment-controller

e2e-mt-3bb80f8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3bb80f8b-openshift-default-55c66bcbb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-3bb80f8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3bb80f8b

openshift-ingress

multus

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3bb80f8b-859d8d5f77

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3bb80f8b-859d8d5f77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3bb80f8b: serviceaccount "payload-processing-e2e-mt-3bb80f8b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3bb80f8b-859d8d5f77

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3bb80f8b-688c79694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3bb80f8b-688c79694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3bb80f8b: serviceaccount "payload-processing-e2e-mt-3bb80f8b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3bb80f8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3bb80f8b-688c79694 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3bb80f8b-688c79694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3bb80f8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3bb80f8b-859d8d5f77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3bb80f8b-688c79694-fxzss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-1145ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1145ca

openshift-ingress

deployment-controller

e2e-api-a-1145ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1145ca-openshift-default-6dffb6f6d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-1145ca-openshift-default-6dffb6f6d6

SuccessfulCreate

Created pod: e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

openshift-ingress

multus

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1145ca: serviceaccount "payload-processing-e2e-api-a-1145ca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1145ca-5d49df48c7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1145ca-5d49df48c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1145ca: serviceaccount "payload-processing-e2e-api-a-1145ca" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1145ca-5d49df48c7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1145ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1145ca-56c794dcd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1145ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1145ca-5d49df48c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-4e2141-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4e2141-openshift-default-76bf95f98d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4e2141-openshift-default-76bf95f98d

SuccessfulCreate

Created pod: e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

openshift-ingress

multus

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-4e2141

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4e2141
(x5)

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4e2141

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4e2141-754cf59b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e2141-754cf59b99

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e2141-754cf59b99

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4e2141-754cf59b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e2141: serviceaccount "payload-processing-e2e-api-b-4e2141" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4e2141

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4e2141-6778cc6946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e2141-6778cc6946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e2141-6778cc6946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4e2141-6778cc6946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e2141: serviceaccount "payload-processing-e2e-api-b-4e2141" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1145ca-56c794dcd6-w2kch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1145ca-5d49df48c7-5wgj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2141-6778cc6946-pb8x8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-11dfb4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-11dfb4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-11dfb4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-11dfb4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7d3fc46d-4e06-45fd-b1ce-6ebf9eeb2116, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-11dfb4-74b7dcb565-9b79l

Unhealthy

Readiness probe failed: dial tcp 10.133.0.61:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-11dfb4-78fcd44d4b-svp5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-28eb2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-28eb2c

openshift-ingress

deployment-controller

e2e-ipp-a-28eb2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-28eb2c-openshift-default-7fcbf74698 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698

SuccessfulCreate

Created pod: e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

openshift-ingress

multus

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-28eb2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-28eb2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-28eb2c-d9b656657 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-28eb2c: serviceaccount "payload-processing-e2e-ipp-a-28eb2c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-28eb2c-d9b656657

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-28eb2c-d9b656657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-28eb2c: serviceaccount "payload-processing-e2e-ipp-a-28eb2c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-28eb2c-d9b656657

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a89cbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a89cbb

openshift-ingress

deployment-controller

e2e-ipp-b-a89cbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a89cbb-openshift-default-d956d64db from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a89cbb-openshift-default-d956d64db

SuccessfulCreate

Created pod: e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

openshift-ingress

multus

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a89cbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a89cbb: serviceaccount "payload-processing-e2e-ipp-b-a89cbb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a89cbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a89cbb: serviceaccount "payload-processing-e2e-ipp-b-a89cbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

openshift-ingress

multus

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-7f92a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-7f92a9

openshift-ingress

deployment-controller

e2e-ipp-cleanup-7f92a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448

SuccessfulCreate

Created pod: e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

openshift-ingress

multus

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-7f92a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-7f92a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7f92a9: serviceaccount "payload-processing-e2e-ipp-cleanup-7f92a9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7f92a9: serviceaccount "payload-processing-e2e-ipp-cleanup-7f92a9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-7f92a9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7f92a9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-7f92a9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7f92a9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e3130cc9-578f-4e2d-b033-5d647c78b002, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7f92a9-6d5f5c7b99-r962r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7f92a9-579784589d-q4j2n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a89cbb-5798dd4d9d-bl4m4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a89cbb-59b4f6b95c-q5d7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ef8f61-7cfdb77f78-vq5jl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-f83533

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-f83533": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6fc1db7f-93e2-4e9c-aeca-5fffd3045c66, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr

Killing

Stopping container istio-proxy