Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-febb9564-85454df666-vjdkd to ip-10-0-131-60.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckhtwd to ip-10-0-128-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk to ip-10-0-128-17.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f to ip-10-0-128-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-2frhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 to ip-10-0-128-82.ec2.internal

openshift-ingress

kube-auth-proxy-65879f568d-tpmh6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65879f568d-tpmh6 to ip-10-0-128-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92 to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm to ip-10-0-131-60.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-xl9xk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-xl9xk to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9 to ip-10-0-131-60.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-zhmcq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-zhmcq to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc to ip-10-0-131-60.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-fc55k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6 to ip-10-0-131-60.ec2.internal

openshift-ingress

kube-auth-proxy-65879f568d-mb5rv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65879f568d-mb5rv to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9 to ip-10-0-128-82.ec2.internal

openshift-ingress

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj to ip-10-0-128-82.ec2.internal

openshift-ingress

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9 to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw to ip-10-0-131-60.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6 to ip-10-0-131-60.ec2.internal

openshift-ingress

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb to ip-10-0-128-82.ec2.internal

openshift-ingress

router-default-5b94f5687b-gj2pp

Scheduled

Successfully assigned openshift-ingress/router-default-5b94f5687b-gj2pp to ip-10-0-128-82.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b94f5687b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-5b94f5687b

FailedCreate

Error creating: pods "router-default-5b94f5687b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5b94f5687b

FailedCreate

Error creating: pods "router-default-5b94f5687b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5b94f5687b

SuccessfulCreate

Created pod: router-default-5b94f5687b-gj2pp
(x6)

openshift-ingress

kubelet

router-default-5b94f5687b-gj2pp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5b94f5687b-gj2pp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-5b94f5687b-gj2pp

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b94f5687b-gj2pp

Started

Started container router

openshift-ingress

kubelet

router-default-5b94f5687b-gj2pp

Created

Created container: router

openshift-ingress

kubelet

router-default-5b94f5687b-gj2pp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-65879f568d from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-65879f568d

FailedCreate

Error creating: pods "kube-auth-proxy-65879f568d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-tpmh6

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-mb5rv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-65879f568d

SuccessfulCreate

Created pod: kube-auth-proxy-65879f568d-mb5rv

openshift-ingress

replicaset-controller

kube-auth-proxy-65879f568d

SuccessfulCreate

Created pod: kube-auth-proxy-65879f568d-tpmh6

openshift-ingress

multus

kube-auth-proxy-65879f568d-mb5rv

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-tpmh6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65879f568d-tpmh6

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-fc55k

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fc55k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-fc55k

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-tpmh6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-mb5rv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-mb5rv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.345s (3.345s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-tpmh6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.744s (2.744s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-tpmh6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65879f568d-mb5rv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fc55k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fc55k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.673s (3.673s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fc55k

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-xl9xk

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-xl9xk

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.593s (3.593s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.627s (3.627s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6r58f

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.146s (3.146s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bckhtwd

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-xl9xk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-fc55k

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fc55k

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vkxwq

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.022s (5.022s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-2frhk

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-zhmcq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-2frhk

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-zhmcq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-zhmcq

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-zhmcq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-zhmcq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.43s (3.43s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-zhmcq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.459s (3.459s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vkxwq

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Unhealthy

Liveness probe failed: dial tcp 10.132.0.50:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-2frhk

Unhealthy

Readiness probe failed: dial tcp 10.132.0.50:9004: connect: connection refused

openshift-ingress

multus

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-b701e0ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b701e0ce

openshift-ingress

deployment-controller

e2e-ait-b701e0ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b701e0ce-openshift-default-5747865546 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b701e0ce-openshift-default-5747865546

SuccessfulCreate

Created pod: e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b701e0ce: serviceaccount "payload-processing-e2e-ait-b701e0ce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b701e0ce: serviceaccount "payload-processing-e2e-ait-b701e0ce" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b701e0ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b701e0ce-644b5f9448 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b701e0ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b701e0ce-6bdf44bdf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-dfc96bfb-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-dfc96bfb-gw

openshift-ingress

deployment-controller

e2e-migrate-dfc96bfb-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648

SuccessfulCreate

Created pod: e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

openshift-ingress

multus

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dfc96bfb-576bdc7769

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-dfc96bfb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-dfc96bfb-576bdc7769 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dfc96bfb: serviceaccount "payload-processing-e2e-migrate-dfc96bfb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-dfc96bfb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dfc96bfb-576bdc7769

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-dfc96bfb-576bdc7769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dfc96bfb: serviceaccount "payload-processing-e2e-migrate-dfc96bfb" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.798s (1.798s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-dfc96bfb-576bdc7769-n85c9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd

SuccessfulCreate

Created pod: e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

openshift-ingress

deployment-controller

e2e-ait-3a6cf6a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3a6cf6a5-openshift-default-68f7b649cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-3a6cf6a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3a6cf6a5

openshift-ingress

multus

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a6cf6a5: serviceaccount "payload-processing-e2e-ait-3a6cf6a5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3a6cf6a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a6cf6a5: serviceaccount "payload-processing-e2e-ait-3a6cf6a5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3a6cf6a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3a6cf6a5-dd4fbc666 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6cf6a5-dd4fbc666-686lj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6cf6a5-846c98b96-cdm8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0ac50acb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0ac50acb

openshift-ingress

replicaset-controller

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8

SuccessfulCreate

Created pod: e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

openshift-ingress

deployment-controller

e2e-derive-0ac50acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0ac50acb-openshift-default-9d9b5b7d8 from 0 to 1

openshift-ingress

multus

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0ac50acb-88687d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0ac50acb-88687d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0ac50acb: serviceaccount "payload-processing-e2e-derive-0ac50acb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0ac50acb-88687d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0ac50acb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0ac50acb-88687d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0ac50acb-548cb7cbf8

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0ac50acb-548cb7cbf8

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0ac50acb-548cb7cbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0ac50acb: serviceaccount "payload-processing-e2e-derive-0ac50acb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0ac50acb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0ac50acb-548cb7cbf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-0ac50acb-548cb7cbf8-mkvkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0ac50acb-88687d4-jnwbt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-04a2be95-openshift-default-57fd4c6cdd

SuccessfulCreate

Created pod: e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

openshift-ingress

deployment-controller

e2e-mt-04a2be95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-04a2be95-openshift-default-57fd4c6cdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-04a2be95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-04a2be95

openshift-ingress

multus

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-04a2be95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-04a2be95-c8c585d88 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-04a2be95-7d9b5474

FailedCreate

Error creating: pods "payload-processing-e2e-mt-04a2be95-7d9b5474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-04a2be95: serviceaccount "payload-processing-e2e-mt-04a2be95" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-04a2be95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-04a2be95-7d9b5474 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-04a2be95-c8c585d88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

openshift-ingress

multus

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-04a2be95-7d9b5474

SuccessfulCreate

Created pod: payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

openshift-ingress

kubelet

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-04a2be95-c8c585d88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-04a2be95-c8c585d88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-04a2be95: serviceaccount "payload-processing-e2e-mt-04a2be95" not found

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Unhealthy

Readiness probe failed: dial tcp 10.133.0.43:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Unhealthy

Readiness probe failed: dial tcp 10.133.0.44:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-04a2be95-c8c585d88-l2ddw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-04a2be95-7d9b5474-xq9h9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-febb9564

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-febb9564

openshift-ingress

multus

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-febb9564-openshift-default-57c7488968

SuccessfulCreate

Created pod: e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

openshift-ingress

deployment-controller

e2e-mt-febb9564-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-febb9564-openshift-default-57c7488968 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-febb9564: serviceaccount "payload-processing-e2e-mt-febb9564" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-febb9564

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-febb9564-6f4777bfd8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-febb9564-85454df666

FailedCreate

Error creating: pods "payload-processing-e2e-mt-febb9564-85454df666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-febb9564: serviceaccount "payload-processing-e2e-mt-febb9564" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-febb9564-85454df666

SuccessfulCreate

Created pod: payload-processing-e2e-mt-febb9564-85454df666-vjdkd

openshift-ingress

deployment-controller

payload-processing-e2e-mt-febb9564

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-febb9564-85454df666 from 0 to 1

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-febb9564-85454df666-vjdkd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-febb9564-6f4777bfd8-5dn92

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-febb9564-openshift-default-57c7488968-q4gs8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-deb398-openshift-default-84d79b68dd

SuccessfulCreate

Created pod: e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

openshift-ingress

gateway_labeler_controller

e2e-inf-a-deb398

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-deb398

openshift-ingress

deployment-controller

e2e-inf-a-deb398-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-deb398-openshift-default-84d79b68dd from 0 to 1

openshift-ingress

multus

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-deb398

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-deb398-547b5fd6b4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-deb398: serviceaccount "payload-processing-e2e-inf-a-deb398" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-deb398

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-deb398-849f9ffc6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-deb398-547b5fd6b4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-deb398-547b5fd6b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-deb398: serviceaccount "payload-processing-e2e-inf-a-deb398" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-deb398-547b5fd6b4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3602fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3602fc

openshift-ingress

multus

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-3602fc-openshift-default-84dbc98d6d

SuccessfulCreate

Created pod: e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

openshift-ingress

deployment-controller

e2e-inf-b-3602fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3602fc-openshift-default-84dbc98d6d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3602fc: serviceaccount "payload-processing-e2e-inf-b-3602fc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3602fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3602fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3602fc-76b5c8bcdd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3602fc: serviceaccount "payload-processing-e2e-inf-b-3602fc" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-deb398

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-deb398: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-deb398": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-deb398, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 53946815-65d5-46ad-914d-7f5c2f444f6c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-deb398-849f9ffc6-fz6h8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-deb398-547b5fd6b4-5jsv2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-3602fc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-3602fc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-3602fc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-3602fc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ac8f8f16-9ed4-46f3-b343-087b09714c40, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3602fc-6dc65b948d-xhb8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3602fc-76b5c8bcdd-lmkph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-2e153a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2e153a

openshift-ingress

deployment-controller

e2e-api-a-2e153a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2e153a-openshift-default-65b8784946 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-2e153a-openshift-default-65b8784946

SuccessfulCreate

Created pod: e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

openshift-ingress

multus

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2e153a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2e153a-7b566999cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2e153a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2e153a-746d6bfd8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2e153a-7b566999cd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2e153a-7b566999cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e153a: serviceaccount "payload-processing-e2e-api-a-2e153a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e153a: serviceaccount "payload-processing-e2e-api-a-2e153a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2e153a-7b566999cd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg
(x2)

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-2eaba9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2eaba9

openshift-ingress

multus

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-2eaba9-openshift-default-b8dbf7df4

SuccessfulCreate

Created pod: e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

openshift-ingress

deployment-controller

e2e-api-b-2eaba9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2eaba9-openshift-default-b8dbf7df4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2eaba9: serviceaccount "payload-processing-e2e-api-b-2eaba9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

openshift-ingress

kubelet

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2eaba9-65bb8566db

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2eaba9-65bb8566db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2eaba9: serviceaccount "payload-processing-e2e-api-b-2eaba9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2eaba9-65bb8566db

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2eaba9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2eaba9-65bb8566db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2eaba9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Unhealthy

Readiness probe failed: dial tcp 10.133.0.58:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e153a-746d6bfd8-mdg6s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e153a-7b566999cd-q9nqg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-2eaba9-65bb8566db-cg79k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2eaba9-9ff4c7c7b-d4vg6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-92434d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-92434d-openshift-default-bd866cf8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-92434d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-92434d

openshift-ingress

kubelet

e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-92434d-openshift-default-bd866cf8d

SuccessfulCreate

Created pod: e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-92434d-78c76847d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-92434d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-92434d-78c76847d4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-92434d-78c76847d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-92434d-78c76847d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-92434d: serviceaccount "payload-processing-e2e-shared-a-92434d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-92434d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-92434d-6f579b7b7d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-92434d-6f579b7b7d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-92434d-6f579b7b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-92434d: serviceaccount "payload-processing-e2e-shared-a-92434d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-92434d-6f579b7b7d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

openshift-ingress

multus

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": read tcp 10.132.0.2:50056->10.132.0.79:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": read tcp 10.132.0.2:50056->10.132.0.79:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-57997e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-57997e-openshift-default-79d4bbd7d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-57997e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-57997e

openshift-ingress

replicaset-controller

e2e-shared-b-57997e-openshift-default-79d4bbd7d8

SuccessfulCreate

Created pod: e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

openshift-ingress

multus

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-57997e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-57997e-f6b54dc4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-57997e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-57997e-f6b54dc4b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-57997e: serviceaccount "payload-processing-e2e-shared-b-57997e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-57997e-f6b54dc4b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-57997e-f6b54dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-57997e: serviceaccount "payload-processing-e2e-shared-b-57997e" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Unhealthy

Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

ProbeError

Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0b8087

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0b8087

openshift-ingress

replicaset-controller

e2e-ipp-a-0b8087-openshift-default-f969fc55b

SuccessfulCreate

Created pod: e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

openshift-ingress

multus

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-0b8087-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0b8087-openshift-default-f969fc55b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0b8087

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0b8087

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0b8087: serviceaccount "payload-processing-e2e-ipp-a-0b8087" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

openshift-ingress

multus

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0b8087: serviceaccount "payload-processing-e2e-ipp-a-0b8087" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576

SuccessfulCreate

Created pod: e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

openshift-ingress

deployment-controller

e2e-ipp-b-ca1c80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ca1c80-openshift-default-6b88fb9576 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ca1c80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ca1c80

openshift-ingress

multus

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ca1c80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ca1c80-6d7d97646d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ca1c80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca1c80: serviceaccount "payload-processing-e2e-ipp-b-ca1c80" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ca1c80: serviceaccount "payload-processing-e2e-ipp-b-ca1c80" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": read tcp 10.134.0.2:45810->10.134.0.52:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": read tcp 10.134.0.2:45810->10.134.0.52:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754

SuccessfulCreate

Created pod: e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

openshift-ingress

deployment-controller

e2e-ipp-cleanup-32fc6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-32fc6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-32fc6e

openshift-ingress

multus

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-32fc6e: serviceaccount "payload-processing-e2e-ipp-cleanup-32fc6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-32fc6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-32fc6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-32fc6e: serviceaccount "payload-processing-e2e-ipp-cleanup-32fc6e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-32fc6e-587d4d59d6-z5zxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-32fc6e-6587b97d68-kfqw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0b8087-64cb6b5f5b-gzztg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0b8087-79f7d758d4-4dk6h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ca1c80-6d7d97646d-n8ggm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ca1c80-6f944dc6d-8hp2r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ca1c80-openshift-default-6b88fb9576-pg4xk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92434d-6f579b7b7d-s2wnw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92434d-78c76847d4-lnptr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-57997e-f6b54dc4b-vdjc6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-57997e-5b89c7d78d-wdkh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503