Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl to ip-10-0-141-37.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcs62mh to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9 to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6 to ip-10-0-141-37.ec2.internal

openshift-ingress

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4 to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs to ip-10-0-141-37.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8 to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9 to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp to ip-10-0-141-37.ec2.internal

openshift-ingress

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5 to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679 to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-12e4a979-f69b896db-96d9h to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn to ip-10-0-141-37.ec2.internal

openshift-ingress

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6 to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv to ip-10-0-141-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zjc2h

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zjc2h to ip-10-0-138-228.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p2lzb to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85 to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq to ip-10-0-141-37.ec2.internal

openshift-ingress

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8 to ip-10-0-138-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-z9rmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-z9rmx to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9 to ip-10-0-141-37.ec2.internal

openshift-ingress

kube-auth-proxy-7c99fc649-hvhzg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c99fc649-hvhzg to ip-10-0-143-58.ec2.internal

openshift-ingress

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9 to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8 to ip-10-0-143-58.ec2.internal

openshift-ingress

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-76d454-openshift-default-88b588864-kmfdf to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp to ip-10-0-141-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bcxxr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bcxxr to ip-10-0-141-37.ec2.internal

openshift-ingress

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g to ip-10-0-138-228.ec2.internal

openshift-ingress

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn to ip-10-0-138-228.ec2.internal

openshift-ingress

kube-auth-proxy-7c99fc649-hq2hm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c99fc649-hq2hm to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7 to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c to ip-10-0-143-58.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8 to ip-10-0-141-37.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-w7ssw

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-w7ssw to ip-10-0-141-37.ec2.internal

openshift-ingress

router-default-66d8d8f5b-rrnmh

Scheduled

Successfully assigned openshift-ingress/router-default-66d8d8f5b-rrnmh to ip-10-0-138-228.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-66d8d8f5b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-66d8d8f5b

FailedCreate

Error creating: pods "router-default-66d8d8f5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-66d8d8f5b

FailedCreate

Error creating: pods "router-default-66d8d8f5b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-66d8d8f5b

SuccessfulCreate

Created pod: router-default-66d8d8f5b-rrnmh
(x5)

openshift-ingress

kubelet

router-default-66d8d8f5b-rrnmh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-66d8d8f5b-rrnmh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-66d8d8f5b-rrnmh

Started

Started container router

openshift-ingress

kubelet

router-default-66d8d8f5b-rrnmh

Created

Created container: router

openshift-ingress

kubelet

router-default-66d8d8f5b-rrnmh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

multus

router-default-66d8d8f5b-rrnmh

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c99fc649 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7c99fc649-hq2hm

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7c99fc649

SuccessfulCreate

Created pod: kube-auth-proxy-7c99fc649-hq2hm

openshift-ingress

multus

kube-auth-proxy-7c99fc649-hvhzg

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hvhzg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-7c99fc649

FailedCreate

Error creating: pods "kube-auth-proxy-7c99fc649-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7c99fc649

SuccessfulCreate

Created pod: kube-auth-proxy-7c99fc649-hvhzg

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hq2hm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bcxxr

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hq2hm

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hq2hm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.996s (2.996s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hq2hm

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bcxxr

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hvhzg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.393s (3.393s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hvhzg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c99fc649-hvhzg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.898s (2.898s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zjc2h

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zjc2h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zjc2h

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.833s (2.833s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.749s (2.749s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-n2qlg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zjc2h

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zjc2h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.392s (3.392s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zjc2h

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bcxxr

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bcxxr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcs62mh

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-p2lzb

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-z9rmx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-w7ssw
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

multus

payload-processing-5cc6cd444b-w7ssw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-w7ssw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-z9rmx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-z9rmx

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-z9rmx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-z9rmx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.181s (2.181s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-z9rmx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-w7ssw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.142s (2.142s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-w7ssw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-w7ssw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p2lzb

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-fbbe1196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fbbe1196

openshift-ingress

deployment-controller

e2e-ait-fbbe1196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fbbe1196-openshift-default-7b5cbdd85b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b

SuccessfulCreate

Created pod: e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

openshift-ingress

multus

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fbbe1196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fbbe1196: serviceaccount "payload-processing-e2e-ait-fbbe1196" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fbbe1196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fbbe1196-b8c44b984 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fbbe1196-b8c44b984

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fbbe1196-b8c44b984

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fbbe1196-b8c44b984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fbbe1196: serviceaccount "payload-processing-e2e-ait-fbbe1196" not found
(x2)

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-fbbe1196-b8c44b984-5fphq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fbbe1196-7fbd44bdcb-pbdw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-fbbe1196-openshift-default-7b5cbdd85b-pd4f8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-41ad7fbb-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-41ad7fbb-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-41ad7fbb-gw

openshift-ingress

replicaset-controller

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548

SuccessfulCreate

Created pod: e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

openshift-ingress

multus

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-41ad7fbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-41ad7fbb-88c8bd465

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-41ad7fbb-88c8bd465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-41ad7fbb: serviceaccount "payload-processing-e2e-migrate-41ad7fbb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-41ad7fbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-41ad7fbb-88c8bd465 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-41ad7fbb-88c8bd465

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

openshift-ingress

kubelet

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-41ad7fbb: serviceaccount "payload-processing-e2e-migrate-41ad7fbb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.984s (1.984s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41ad7fbb-64dcbfd684-lt6sp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-41ad7fbb-88c8bd465-gvc5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-41ad7fbb-gw-openshift-default-55744d7548-dphm4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ait-1d0f63d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1d0f63d4

openshift-ingress

deployment-controller

e2e-ait-1d0f63d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1d0f63d4-openshift-default-54798fbb64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1d0f63d4-openshift-default-54798fbb64

SuccessfulCreate

Created pod: e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

openshift-ingress

multus

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d0f63d4: serviceaccount "payload-processing-e2e-ait-1d0f63d4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d0f63d4: serviceaccount "payload-processing-e2e-ait-1d0f63d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1d0f63d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

openshift-ingress

multus

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1d0f63d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-1d0f63d4-7fbbd9dbbd-6pvb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d0f63d4-6dd444d59b-h9lvm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-12e4a979-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-12e4a979-openshift-default-56d7ff45b4 from 0 to 1

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-12e4a979-openshift-default-56d7ff45b4

SuccessfulCreate

Created pod: e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

openshift-ingress

gateway_labeler_controller

e2e-derive-12e4a979

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-12e4a979

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-1d0f63d4-openshift-default-54798fbb64-vdpf5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.801s (2.801s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-12e4a979: serviceaccount "payload-processing-e2e-derive-12e4a979" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-12e4a979

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-12e4a979-746b9d56dd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-12e4a979-f69b896db

SuccessfulCreate

Created pod: payload-processing-e2e-derive-12e4a979-f69b896db-96d9h
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-12e4a979-f69b896db

FailedCreate

Error creating: pods "payload-processing-e2e-derive-12e4a979-f69b896db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-12e4a979: serviceaccount "payload-processing-e2e-derive-12e4a979" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

openshift-ingress

deployment-controller

payload-processing-e2e-derive-12e4a979

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-12e4a979-f69b896db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-12e4a979-openshift-default-56d7ff45b4-69mh6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-12e4a979-746b9d56dd-2k58n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-12e4a979-f69b896db-96d9h

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-4f48a67f-openshift-default-684c75cb88

SuccessfulCreate

Created pod: e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

openshift-ingress

multus

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-4f48a67f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4f48a67f

openshift-ingress

deployment-controller

e2e-mt-4f48a67f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4f48a67f-openshift-default-684c75cb88 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4f48a67f-f868c5f86

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4f48a67f-f868c5f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4f48a67f: serviceaccount "payload-processing-e2e-mt-4f48a67f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4f48a67f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4f48a67f-f868c5f86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4f48a67f-f868c5f86

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4f48a67f: serviceaccount "payload-processing-e2e-mt-4f48a67f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4f48a67f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4f48a67f-54ff498b4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Unhealthy

Readiness probe failed: dial tcp 10.134.0.57:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Unhealthy

Liveness probe failed: dial tcp 10.134.0.57:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f48a67f-54ff498b4-r6qhk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4f48a67f-f868c5f86-dsdm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4f48a67f-openshift-default-684c75cb88-lbc85

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-b60f38ad-openshift-default-b486c768d

SuccessfulCreate

Created pod: e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

openshift-ingress

GatewayAuthBootstrap

e2e-mt-b60f38ad

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-b60f38ad-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-b60f38ad-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-b60f38ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b60f38ad

openshift-ingress

deployment-controller

e2e-mt-b60f38ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b60f38ad-openshift-default-b486c768d from 0 to 1

openshift-ingress

multus

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b60f38ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b60f38ad-d5f85ccfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b60f38ad-d5f85ccfd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b60f38ad-d5f85ccfd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b60f38ad-d5f85ccfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b60f38ad: serviceaccount "payload-processing-e2e-mt-b60f38ad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b60f38ad-67c456b896

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b60f38ad-67c456b896

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b60f38ad-67c456b896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b60f38ad: serviceaccount "payload-processing-e2e-mt-b60f38ad" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b60f38ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b60f38ad-67c456b896 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": read tcp 10.133.0.2:32792->10.133.0.38:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": read tcp 10.133.0.2:32792->10.133.0.38:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b60f38ad-67c456b896-6srs9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b60f38ad-d5f85ccfd-qbwwl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-b60f38ad

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-b60f38ad: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-b60f38ad": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-b60f38ad, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c6b0c962-22ae-451e-a5bc-120ed6ff9a70, UID in object meta:

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-b60f38ad-openshift-default-b486c768d-cpjcx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-19f4b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-19f4b3-openshift-default-59fcf75688 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-19f4b3-openshift-default-59fcf75688

SuccessfulCreate

Created pod: e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

openshift-ingress

gateway_labeler_controller

e2e-inf-a-19f4b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-19f4b3

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-19f4b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-19f4b3-664757f64d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-19f4b3-664757f64d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-19f4b3-664757f64d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-19f4b3-664757f64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-19f4b3: serviceaccount "payload-processing-e2e-inf-a-19f4b3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-19f4b3: serviceaccount "payload-processing-e2e-inf-a-19f4b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-19f4b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-76d454

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-76d454

openshift-ingress

replicaset-controller

e2e-inf-b-76d454-openshift-default-88b588864

SuccessfulCreate

Created pod: e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

openshift-ingress

deployment-controller

e2e-inf-b-76d454-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-76d454-openshift-default-88b588864 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-76d454-59bff8b8dd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

openshift-ingress

kubelet

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-76d454

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-76d454-59bff8b8dd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-76d454

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-76d454-6889b7d684 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-76d454-59bff8b8dd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-76d454-59bff8b8dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-76d454: serviceaccount "payload-processing-e2e-inf-b-76d454" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-76d454-6889b7d684

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-76d454-6889b7d684

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-76d454-6889b7d684-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-76d454: serviceaccount "payload-processing-e2e-inf-b-76d454" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-19f4b3-6bc9d95876-lf95p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-19f4b3-664757f64d-ktscn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-19f4b3-openshift-default-59fcf75688-bf8nh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-76d454-59bff8b8dd-lnbsx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-76d454

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-76d454: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-76d454": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-76d454, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d5a1a888-916e-496b-962b-c8ca0a1b603c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-76d454-6889b7d684-g2mbc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-76d454-openshift-default-88b588864-kmfdf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-d5bdd1-openshift-default-744c7d89fb

SuccessfulCreate

Created pod: e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

openshift-ingress

deployment-controller

e2e-api-a-d5bdd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d5bdd1-openshift-default-744c7d89fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-d5bdd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d5bdd1

openshift-ingress

multus

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5bdd1-54449bd5f6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d5bdd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d5bdd1-999f99c56 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d5bdd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d5bdd1-54449bd5f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5bdd1: serviceaccount "payload-processing-e2e-api-a-d5bdd1" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5bdd1-54449bd5f6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d5bdd1-54449bd5f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5bdd1: serviceaccount "payload-processing-e2e-api-a-d5bdd1" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Unhealthy

Readiness probe failed: dial tcp 10.134.0.70:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-adc09f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-adc09f-openshift-default-696df7cb7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-adc09f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-adc09f

openshift-ingress

replicaset-controller

e2e-api-b-adc09f-openshift-default-696df7cb7b

SuccessfulCreate

Created pod: e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

openshift-ingress

multus

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-adc09f-cc748fc8d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-adc09f-cc748fc8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-adc09f: serviceaccount "payload-processing-e2e-api-b-adc09f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-adc09f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-adc09f-cc748fc8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-adc09f-7c77555948

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-adc09f-7c77555948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-adc09f: serviceaccount "payload-processing-e2e-api-b-adc09f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-adc09f-7c77555948

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-adc09f-cc748fc8d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

openshift-ingress

multus

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-adc09f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-adc09f-7c77555948 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:52304->10.133.0.43:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:52304->10.133.0.43:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5bdd1-54449bd5f6-vns7c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5bdd1-999f99c56-89sxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-d5bdd1-openshift-default-744c7d89fb-n5npn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-adc09f-cc748fc8d-jbzl9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-adc09f-7c77555948-5r5sj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-adc09f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-adc09f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-adc09f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-adc09f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f8bf9422-4c79-4b5e-bbfa-2caedae0911a, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-adc09f-openshift-default-696df7cb7b-zns6g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b

SuccessfulCreate

Created pod: e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

openshift-ingress

deployment-controller

e2e-shared-a-3f8e0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-3f8e0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-3f8e0d

openshift-ingress

multus

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-3f8e0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-3f8e0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-3f8e0d-85d6bd595d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-3f8e0d: serviceaccount "payload-processing-e2e-shared-a-3f8e0d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-3f8e0d: serviceaccount "payload-processing-e2e-shared-a-3f8e0d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

openshift-ingress

multus

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-30613e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-30613e

openshift-ingress

replicaset-controller

e2e-shared-b-30613e-openshift-default-85b8666d56

SuccessfulCreate

Created pod: e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

openshift-ingress

deployment-controller

e2e-shared-b-30613e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-30613e-openshift-default-85b8666d56 from 0 to 1

openshift-ingress

multus

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-30613e-5b86c75688

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-30613e-5b86c75688-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-30613e: serviceaccount "payload-processing-e2e-shared-b-30613e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-30613e-858c669bd6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-30613e-858c669bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-30613e: serviceaccount "payload-processing-e2e-shared-b-30613e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-30613e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-30613e-858c669bd6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-30613e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-30613e-5b86c75688 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-30613e-5b86c75688

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-30613e-858c669bd6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:55902->10.132.0.63:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:55902->10.132.0.63:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-4babb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4babb1-openshift-default-58f744db54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-4babb1-openshift-default-58f744db54

SuccessfulCreate

Created pod: e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4babb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4babb1

openshift-ingress

multus

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4babb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4babb1-665c94dc46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4babb1-665c94dc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4babb1: serviceaccount "payload-processing-e2e-ipp-a-4babb1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4babb1-665c94dc46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4babb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4babb1-665c94dc46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4babb1: serviceaccount "payload-processing-e2e-ipp-a-4babb1" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-a83758-openshift-default-869cb8d5dd

SuccessfulCreate

Created pod: e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

openshift-ingress

deployment-controller

e2e-ipp-b-a83758-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a83758-openshift-default-869cb8d5dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a83758

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a83758

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a83758: serviceaccount "payload-processing-e2e-ipp-b-a83758" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a83758

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a83758-776f965dd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a83758-776f965dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a83758: serviceaccount "payload-processing-e2e-ipp-b-a83758" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a83758-776f965dd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a83758

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a83758-776f965dd4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-fb84d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-fb84d0

openshift-ingress

deployment-controller

e2e-ipp-cleanup-fb84d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

openshift-ingress

multus

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fb84d0: serviceaccount "payload-processing-e2e-ipp-cleanup-fb84d0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-fb84d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fb84d0: serviceaccount "payload-processing-e2e-ipp-cleanup-fb84d0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-fb84d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fb84d0-5d5b5f946d-lwlv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fb84d0-5dc44d44fb-6frhs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-fb84d0-openshift-default-7b6c95b44d-n9m6s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4babb1-665c94dc46-h4ngv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4babb1-695b4f5d7b-ssphq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-4babb1-openshift-default-58f744db54-hx679

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a83758-546f48c6bd-kh5s8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a83758-776f965dd4-rddbs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a83758-openshift-default-869cb8d5dd-jql7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f8e0d-5cddb44b6d-lvn6c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f8e0d-85d6bd595d-c9s9v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-3f8e0d-openshift-default-6b774f8b5b-584pp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-30613e-5b86c75688-vmwhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-30613e-858c669bd6-fkjj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-30613e-openshift-default-85b8666d56-6vtm9

Killing

Stopping container istio-proxy