Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Scheduled

Successfully assigned openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848 to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2 to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58 to ip-10-0-132-108.ec2.internal

openshift-ingress

router-default-f877b5d76-g48vt

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4 to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-r26vb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-r26vb to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp to ip-10-0-132-108.ec2.internal

openshift-ingress

kube-auth-proxy-9c7c6d7b-pkc2d

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c7c6d7b-pkc2d to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk to ip-10-0-134-159.ec2.internal

openshift-ingress

router-default-f877b5d76-g48vt

Scheduled

Successfully assigned openshift-ingress/router-default-f877b5d76-g48vt to ip-10-0-141-21.ec2.internal

openshift-ingress

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl to ip-10-0-132-108.ec2.internal

openshift-ingress

kube-auth-proxy-9c7c6d7b-xknf2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c7c6d7b-xknf2 to ip-10-0-141-21.ec2.internal

openshift-ingress

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv to ip-10-0-132-108.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-qxqgq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qxqgq to ip-10-0-141-21.ec2.internal

openshift-ingress

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs to ip-10-0-132-108.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-b6lkl to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e3070304-openshift-default-b9558789b-6snf7 to ip-10-0-134-159.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m to ip-10-0-141-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8 to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Scheduled

Successfully assigned openshift-ingress/e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6 to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-chm2z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc to ip-10-0-134-159.ec2.internal

openshift-ingress

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts to ip-10-0-132-108.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mhxvq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq to ip-10-0-132-108.ec2.internal

openshift-ingress

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v to ip-10-0-132-108.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f to ip-10-0-134-159.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v to ip-10-0-132-108.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-f877b5d76 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-f877b5d76

FailedCreate

Error creating: pods "router-default-f877b5d76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-f877b5d76

FailedCreate

Error creating: pods "router-default-f877b5d76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-f877b5d76

SuccessfulCreate

Created pod: router-default-f877b5d76-g48vt
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-f877b5d76-g48vt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-f877b5d76-g48vt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-f877b5d76-g48vt

Started

Started container router

openshift-ingress

kubelet

router-default-f877b5d76-g48vt

Created

Created container: router

openshift-ingress

multus

router-default-f877b5d76-g48vt

AddedInterface

Add eth0 [10.132.0.6/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-f877b5d76-g48vt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-9c7c6d7b

SuccessfulCreate

Created pod: kube-auth-proxy-9c7c6d7b-pkc2d

openshift-ingress

replicaset-controller

kube-auth-proxy-9c7c6d7b

SuccessfulCreate

Created pod: kube-auth-proxy-9c7c6d7b-xknf2

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-9c7c6d7b from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-9c7c6d7b

FailedCreate

Error creating: pods "kube-auth-proxy-9c7c6d7b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-9c7c6d7b-xknf2

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-xknf2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-qxqgq

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-pkc2d

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-9c7c6d7b-pkc2d

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qxqgq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-qxqgq

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-xknf2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-pkc2d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.714s (2.714s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-xknf2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-xknf2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.779s (2.779s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-pkc2d

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9c7c6d7b-pkc2d

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qxqgq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.453s (3.453s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qxqgq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qxqgq

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.886s (2.886s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5hffd

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mhxvq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mhxvq

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.368s (3.368s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mhxvq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qxqgq

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-qxqgq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-b6lkl

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.198s (3.198s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-chm2z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-r26vb
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-chm2z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-chm2z

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-r26vb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-r26vb

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-chm2z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.467s (2.467s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-r26vb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-r26vb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-r26vb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.417s (2.417s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-chm2z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-chm2z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

ProbeError

Readiness probe error: Get "http://10.133.0.24:15021/healthz/ready": read tcp 10.133.0.2:34118->10.133.0.24:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:15021/healthz/ready": read tcp 10.133.0.2:34118->10.133.0.24:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-b6lkl

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-2fd525-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2fd525-openshift-default-775c6cf69d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2fd525

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2fd525

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-e2e8bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-e2e8bc

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4e301e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4e301e

openshift-ingress

multus

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8

SuccessfulCreate

Created pod: e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

openshift-ingress

multus

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-4e301e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6

SuccessfulCreate

Created pod: e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

openshift-ingress

multus

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-2fd525-openshift-default-775c6cf69d

SuccessfulCreate

Created pod: e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

openshift-ingress

deployment-controller

e2e-worker-w0-e2e8bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-e2e8bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-e2e8bc-58f75785bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc: serviceaccount "payload-processing-e2e-worker-w0-e2e8bc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-e2e8bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc: serviceaccount "payload-processing-e2e-worker-w0-e2e8bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4e301e-779cf8d855

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4e301e-779cf8d855

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4e301e-779cf8d855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4e301e: serviceaccount "payload-processing-e2e-worker-w4-4e301e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4e301e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4e301e-779cf8d855 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4e301e: serviceaccount "payload-processing-e2e-worker-w4-4e301e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4e301e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2fd525

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2fd525: serviceaccount "payload-processing-e2e-inf-a-2fd525" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2fd525

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2fd525-788df86f6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2fd525-788df86f6f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2fd525-788df86f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2fd525: serviceaccount "payload-processing-e2e-inf-a-2fd525" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2fd525-788df86f6f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.541s (1.541s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-e3070304-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e3070304-openshift-default-b9558789b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-173fde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-173fde

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 492ms (492ms including waiting). Image size: 166453408 bytes.

openshift-ingress

deployment-controller

e2e-autores-173fde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-173fde-openshift-default-79f4bcdc46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-173fde-openshift-default-79f4bcdc46

SuccessfulCreate

Created pod: e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

openshift-ingress

gateway_labeler_controller

e2e-ait-e3070304

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e3070304

openshift-ingress

replicaset-controller

e2e-ait-e3070304-openshift-default-b9558789b

SuccessfulCreate

Created pod: e2e-ait-e3070304-openshift-default-b9558789b-6snf7

openshift-ingress

multus

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-173fde-76dc8f579d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-173fde-76dc8f579d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-173fde: serviceaccount "payload-processing-e2e-autores-173fde" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-173fde-76dc8f579d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-173fde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-173fde-76dc8f579d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-173fde-66f5ffd4c7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-173fde-66f5ffd4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-173fde: serviceaccount "payload-processing-e2e-autores-173fde" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-173fde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-173fde-66f5ffd4c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-173fde-66f5ffd4c7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

openshift-ingress

multus

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e3070304

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e3070304-66596dff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3070304-7c86775bc9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

openshift-ingress

kubelet

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e3070304

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e3070304-7c86775bc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3070304-66596dff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e3070304-66596dff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3070304: serviceaccount "payload-processing-e2e-ait-e3070304" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3070304-7c86775bc9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e3070304-7c86775bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3070304: serviceaccount "payload-processing-e2e-ait-e3070304" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3070304-66596dff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-376bcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-376bcf

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.222s (1.222s including waiting). Image size: 166453408 bytes.

openshift-ingress

replicaset-controller

e2e-inf-b-376bcf-openshift-default-5946cb444b

SuccessfulCreate

Created pod: e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

openshift-ingress

deployment-controller

e2e-inf-b-376bcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-376bcf-openshift-default-5946cb444b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-376bcf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-376bcf: serviceaccount "payload-processing-e2e-inf-b-376bcf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-376bcf-5f889f848f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-376bcf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-376bcf-5f889f848f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-376bcf-5f889f848f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-376bcf-5f889f848f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-376bcf: serviceaccount "payload-processing-e2e-inf-b-376bcf" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3070304-66596dff8-8996m

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-816f617b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-816f617b-gw

openshift-ingress

deployment-controller

e2e-migrate-816f617b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-816f617b-gw-openshift-default-89d5545dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-816f617b-gw-openshift-default-89d5545dd

SuccessfulCreate

Created pod: e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-e3070304-openshift-default-b9558789b-6snf7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-816f617b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-816f617b-66df7496b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-816f617b-66df7496b6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-816f617b-66df7496b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-816f617b: serviceaccount "payload-processing-e2e-migrate-816f617b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-816f617b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-816f617b-66df7496b6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-816f617b: serviceaccount "payload-processing-e2e-migrate-816f617b" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-816f617b-66df7496b6-hwmrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-816f617b-b6b5c64cd-pv9hk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-083e5ca1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-083e5ca1

openshift-ingress

deployment-controller

e2e-ait-083e5ca1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-083e5ca1-openshift-default-7bd548cc64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-083e5ca1-openshift-default-7bd548cc64

SuccessfulCreate

Created pod: e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

openshift-ingress

multus

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-083e5ca1-7bd8899d47

FailedCreate

Error creating: pods "payload-processing-e2e-ait-083e5ca1-7bd8899d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-083e5ca1: serviceaccount "payload-processing-e2e-ait-083e5ca1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-083e5ca1: serviceaccount "payload-processing-e2e-ait-083e5ca1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-083e5ca1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-083e5ca1-7bd8899d47

SuccessfulCreate

Created pod: payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

openshift-ingress

deployment-controller

payload-processing-e2e-ait-083e5ca1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-083e5ca1-7bd8899d47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-083e5ca1-openshift-default-7bd548cc64-qnlxh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-f689c4cd-openshift-default-5b687bdd5b

SuccessfulCreate

Created pod: e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

openshift-ingress

deployment-controller

e2e-derive-f689c4cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f689c4cd-openshift-default-5b687bdd5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f689c4cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f689c4cd

openshift-ingress

multus

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f689c4cd-67cdd9ff85

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f689c4cd: serviceaccount "payload-processing-e2e-derive-f689c4cd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f689c4cd-67cdd9ff85

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f689c4cd-67cdd9ff85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f689c4cd: serviceaccount "payload-processing-e2e-derive-f689c4cd" not found

openshift-ingress

multus

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f689c4cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f689c4cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f689c4cd-67cdd9ff85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f689c4cd-6d65498cbb-6xnx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-f689c4cd-openshift-default-dockercfg-vgwws); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd

Killing

Stopping container payload-processing

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-7db579

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-7db579-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-7db579-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-explicit-7db579

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7db579

openshift-ingress

deployment-controller

e2e-explicit-7db579-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7db579-openshift-default-55d58d4d68 from 0 to 1

openshift-ingress

kubelet

e2e-autores-173fde-openshift-default-79f4bcdc46-wrj2p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-7db579-openshift-default-55d58d4d68

SuccessfulCreate

Created pod: e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

openshift-ingress

multus

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7db579-84dc7b8885

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7db579-84dc7b8885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7db579: serviceaccount "payload-processing-e2e-explicit-7db579" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7db579

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7db579-84dc7b8885

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7db579: serviceaccount "payload-processing-e2e-explicit-7db579" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7db579

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7db579-84dc7b8885 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-0b0a5312-openshift-default-d4764f488

SuccessfulCreate

Created pod: e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

openshift-ingress

deployment-controller

e2e-mt-0b0a5312-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0b0a5312-openshift-default-d4764f488 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-0b0a5312

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0b0a5312

openshift-ingress

multus

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0b0a5312

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0b0a5312

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0b0a5312-b744bcfd5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0b0a5312-b744bcfd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0b0a5312-b744bcfd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0b0a5312-b744bcfd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0b0a5312: serviceaccount "payload-processing-e2e-mt-0b0a5312" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0b0a5312: serviceaccount "payload-processing-e2e-mt-0b0a5312" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-106d40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-106d40

openshift-ingress

deployment-controller

e2e-noten-106d40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-106d40-openshift-default-7f7c5c78c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-106d40-openshift-default-7f7c5c78c4

SuccessfulCreate

Created pod: e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

openshift-ingress

multus

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548

SuccessfulCreate

Created pod: e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

openshift-ingress

deployment-controller

e2e-shared-a-w2-0766ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-0766ea-openshift-default-78c77bb548 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-0766ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-0766ea

openshift-ingress

multus

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-0766ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea: serviceaccount "payload-processing-e2e-shared-a-w2-0766ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-0766ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-0766ea-74d47477bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea: serviceaccount "payload-processing-e2e-shared-a-w2-0766ea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884

SuccessfulCreate

Created pod: e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

openshift-ingress

deployment-controller

e2e-shared-b-w2-b8cbf1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b8cbf1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b8cbf1

openshift-ingress

multus

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b8cbf1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1: serviceaccount "payload-processing-e2e-shared-b-w2-b8cbf1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b8cbf1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1: serviceaccount "payload-processing-e2e-shared-b-w2-b8cbf1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2fd525-5d5d4648f4-qlqpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-mt-8b864c4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8b864c4f-openshift-default-6df8c5ff64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-8b864c4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8b864c4f

openshift-ingress

replicaset-controller

e2e-mt-8b864c4f-openshift-default-6df8c5ff64

SuccessfulCreate

Created pod: e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

openshift-ingress

multus

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8b864c4f-6878b8dfdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8b864c4f-6878b8dfdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8b864c4f: serviceaccount "payload-processing-e2e-mt-8b864c4f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8b864c4f-6878b8dfdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8b864c4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8b864c4f-6878b8dfdf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8b864c4f-b785877c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8b864c4f-b785877c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8b864c4f: serviceaccount "payload-processing-e2e-mt-8b864c4f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8b864c4f-b785877c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8b864c4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8b864c4f-b785877c4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-376bcf-5f889f848f-l58jn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-376bcf-67dd9cbdc4-mccdr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-d1662a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d1662a-openshift-default-564cb4865b from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-376bcf-openshift-default-5946cb444b-s7kgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d1662a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d1662a

openshift-ingress

multus

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b

SuccessfulCreate

Created pod: e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d1662a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d1662a-59558fd455 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d1662a-59558fd455

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d1662a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a: serviceaccount "payload-processing-e2e-shared-a-w3-d1662a" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d1662a-59558fd455

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d1662a-59558fd455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d1662a: serviceaccount "payload-processing-e2e-shared-a-w3-d1662a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6

SuccessfulCreate

Created pod: e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

openshift-ingress

deployment-controller

e2e-shared-b-w3-4c93ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4c93ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4c93ee

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee: serviceaccount "payload-processing-e2e-shared-b-w3-4c93ee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4c93ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4c93ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4c93ee: serviceaccount "payload-processing-e2e-shared-b-w3-4c93ee" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8b864c4f-6878b8dfdf-2c42f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-a5f8d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a5f8d9

openshift-ingress

deployment-controller

e2e-api-a-a5f8d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46

SuccessfulCreate

Created pod: e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

openshift-ingress

multus

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a5f8d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a5f8d9-5c477b6f89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a5f8d9-5c477b6f89

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a5f8d9-5c477b6f89

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a5f8d9-5c477b6f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a5f8d9: serviceaccount "payload-processing-e2e-api-a-a5f8d9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a5f8d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a5f8d9-57774b9766 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a5f8d9: serviceaccount "payload-processing-e2e-api-a-a5f8d9" not found

openshift-ingress

multus

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-bc4088

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bc4088

openshift-ingress

deployment-controller

e2e-api-b-bc4088-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-bc4088-openshift-default-9946f8db8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-bc4088-openshift-default-9946f8db8

SuccessfulCreate

Created pod: e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-bc4088

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-bc4088-7f5645b65d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bc4088-85dbcf6b95

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-bc4088-85dbcf6b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bc4088: serviceaccount "payload-processing-e2e-api-b-bc4088" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-bc4088

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-bc4088-85dbcf6b95 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bc4088: serviceaccount "payload-processing-e2e-api-b-bc4088" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

openshift-ingress

multus

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bc4088-85dbcf6b95

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

openshift-ingress

multus

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-bc4088-openshift-default-9946f8db8-pnw2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-4e301e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-4e301e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-4e301e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a4e6c8fa-e844-4eb9-b83e-831567ab25a5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e301e-6b695f95c8-m9l8p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-e2e8bc-openshift-default-bbb67c6b6-vwkgj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8cbf1-757d5f4494-s9gvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-e458de-openshift-default-75cc59b89b

SuccessfulCreate

Created pod: e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e458de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e458de

openshift-ingress

deployment-controller

e2e-ipp-a-e458de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e458de-openshift-default-75cc59b89b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e458de-d45cc4f79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e458de-d45cc4f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e458de: serviceaccount "payload-processing-e2e-ipp-a-e458de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e458de-d45cc4f79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e458de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e458de-d45cc4f79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e458de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e458de: serviceaccount "payload-processing-e2e-ipp-a-e458de" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": read tcp 10.134.0.2:59312->10.134.0.86:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": read tcp 10.134.0.2:59312->10.134.0.86:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-63184c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-63184c

openshift-ingress

replicaset-controller

e2e-ipp-b-63184c-openshift-default-5c866788f4

SuccessfulCreate

Created pod: e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

openshift-ingress

deployment-controller

e2e-ipp-b-63184c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-63184c-openshift-default-5c866788f4 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-63184c: serviceaccount "payload-processing-e2e-ipp-b-63184c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-63184c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-63184c-6595c67fd9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-63184c-6595c67fd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-63184c: serviceaccount "payload-processing-e2e-ipp-b-63184c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-63184c-6595c67fd9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-63184c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-63184c-6595c67fd9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e6d769

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e6d769

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e6d769-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e6d769-openshift-default-594567f94b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

openshift-ingress

multus

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e6d769

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e6d769

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769: serviceaccount "payload-processing-e2e-ipp-cleanup-e6d769" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769: serviceaccount "payload-processing-e2e-ipp-cleanup-e6d769" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-e6d769-openshift-default-594567f94b-5gxnk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-e458de

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-e458de": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7ba1a6df-8be5-4821-82f1-045eab953f39, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-63184c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-63184c: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-63184c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-63184c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 86140c60-7b05-46cd-b5b0-d7dd9fa53bf5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d1662a-59558fd455-9hm4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d1662a-6bf6d6bcdb-dl848

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-d1662a-openshift-default-564cb4865b-fklml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c93ee-597bf794ff-7zprm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c93ee-57c975b486-4p4j2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: