Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h to ip-10-0-128-139.ec2.internal

openshift-ingress

kube-auth-proxy-65f654896c-4g4fs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65f654896c-4g4fs to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg to ip-10-0-132-214.ec2.internal

openshift-ingress

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7 to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w to ip-10-0-132-214.ec2.internal

openshift-ingress

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75 to ip-10-0-132-214.ec2.internal

openshift-ingress

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv to ip-10-0-137-145.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r to ip-10-0-132-214.ec2.internal

openshift-ingress

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd to ip-10-0-128-139.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xfrfc to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c028db-d79557994-p8pvp to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg to ip-10-0-137-145.ec2.internal

openshift-ingress

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9 to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8 to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2 to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq to ip-10-0-128-139.ec2.internal

openshift-ingress

kube-auth-proxy-65f654896c-bgwnz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65f654896c-bgwnz to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7 to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5 to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6 to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7 to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-lt4zt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-lt4zt to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c028db-openshift-default-5479dcb646-t2j95 to ip-10-0-128-139.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-75zgg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-75zgg to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw to ip-10-0-128-139.ec2.internal

openshift-ingress

router-default-7cd44fddd-7k9f2

Scheduled

Successfully assigned openshift-ingress/router-default-7cd44fddd-7k9f2 to ip-10-0-132-214.ec2.internal

openshift-ingress

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9 to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7 to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54 to ip-10-0-128-139.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-km5dc

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-km5dc to ip-10-0-132-214.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-znd67

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-znd67 to ip-10-0-132-214.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4 to ip-10-0-128-139.ec2.internal

openshift-ingress

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6 to ip-10-0-137-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6 to ip-10-0-132-214.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7cd44fddd from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x9)

openshift-ingress

replicaset-controller

router-default-7cd44fddd

FailedCreate

Error creating: pods "router-default-7cd44fddd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7cd44fddd

FailedCreate

Error creating: pods "router-default-7cd44fddd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7cd44fddd

SuccessfulCreate

Created pod: router-default-7cd44fddd-7k9f2
(x5)

openshift-ingress

kubelet

router-default-7cd44fddd-7k9f2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7cd44fddd-7k9f2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7cd44fddd-7k9f2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

multus

router-default-7cd44fddd-7k9f2

AddedInterface

Add eth0 [10.133.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7cd44fddd-7k9f2

Created

Created container: router

openshift-ingress

kubelet

router-default-7cd44fddd-7k9f2

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-65f654896c

SuccessfulCreate

Created pod: kube-auth-proxy-65f654896c-4g4fs

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-65f654896c from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-bgwnz

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-65f654896c

FailedCreate

Error creating: pods "kube-auth-proxy-65f654896c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-65f654896c

SuccessfulCreate

Created pod: kube-auth-proxy-65f654896c-bgwnz

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-4g4fs

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-65f654896c-4g4fs

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-4g4fs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65f654896c-bgwnz

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-bgwnz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-75zgg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-4g4fs

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-75zgg

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-4g4fs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.293s (3.293s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-4g4fs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-bgwnz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-bgwnz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.108s (5.108s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65f654896c-bgwnz

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.464s (3.464s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-znd67

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-znd67

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.286s (2.286s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-znd67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.866s (2.866s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b82ht

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-75zgg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-75zgg

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-xfrfc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-lt4zt

openshift-ingress

multus

payload-processing-5cc6cd444b-km5dc

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-km5dc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-lt4zt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-lt4zt

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-km5dc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-lt4zt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-lt4zt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-lt4zt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.738s (1.738s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-km5dc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-km5dc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-km5dc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.484s (2.484s including waiting). Image size: 165907127 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xfrfc

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-93cfcc2b-openshift-default-d7795ccfd

SuccessfulCreate

Created pod: e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

openshift-ingress

deployment-controller

e2e-ait-93cfcc2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-93cfcc2b-openshift-default-d7795ccfd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-93cfcc2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-93cfcc2b

openshift-ingress

multus

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.067s (5.067s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-93cfcc2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-93cfcc2b-cdf8c44b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93cfcc2b: serviceaccount "payload-processing-e2e-ait-93cfcc2b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93cfcc2b: serviceaccount "payload-processing-e2e-ait-93cfcc2b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-93cfcc2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": read tcp 10.134.0.2:33944->10.134.0.50:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": read tcp 10.134.0.2:33944->10.134.0.50:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-93cfcc2b-openshift-default-d7795ccfd-6zpc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-93cfcc2b-cdf8c44b6-n9r2r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-93cfcc2b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-93cfcc2b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-93cfcc2b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-93cfcc2b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 447c5d44-8b3c-4dfe-9526-bd3743564cb4, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93cfcc2b-64dfd7545b-f4pbq

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-2646b40b-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2646b40b-gw

openshift-ingress

deployment-controller

e2e-migrate-2646b40b-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2646b40b-gw-openshift-default-9d68d8468 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468

SuccessfulCreate

Created pod: e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

openshift-ingress

multus

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2646b40b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2646b40b-6658b46845 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2646b40b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2646b40b-6658b46845

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2646b40b-6658b46845

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2646b40b-6658b46845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2646b40b: serviceaccount "payload-processing-e2e-migrate-2646b40b" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2646b40b: serviceaccount "payload-processing-e2e-migrate-2646b40b" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2646b40b-5c8bb8f76d-wdh75

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2646b40b-6658b46845-fc4xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-41669ddd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-41669ddd

openshift-ingress

deployment-controller

e2e-ait-41669ddd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-41669ddd-openshift-default-b9bd547c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-41669ddd-openshift-default-b9bd547c6

SuccessfulCreate

Created pod: e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

openshift-ingress

multus

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-2646b40b-gw-openshift-default-9d68d8468-2dmcc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-41669ddd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-41669ddd: serviceaccount "payload-processing-e2e-ait-41669ddd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

openshift-ingress

multus

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-41669ddd-7d49975bdd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

openshift-ingress

kubelet

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-41669ddd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-41669ddd-7d49975bdd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-41669ddd-7d49975bdd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-41669ddd-7d49975bdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-41669ddd: serviceaccount "payload-processing-e2e-ait-41669ddd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

ProbeError

Readiness probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-41669ddd-68f9cbd4d4-qj65s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-41669ddd-7d49975bdd-n4blg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-43a78dca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-43a78dca

openshift-ingress

deployment-controller

e2e-derive-43a78dca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-43a78dca-openshift-default-665c4ff596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-43a78dca-openshift-default-665c4ff596

SuccessfulCreate

Created pod: e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

openshift-ingress

multus

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-41669ddd-openshift-default-b9bd547c6-jrgdq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-43a78dca-7c46db4744

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

openshift-ingress

kubelet

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-43a78dca-78dd59fb9d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-43a78dca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-43a78dca-7c46db4744 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-43a78dca-7c46db4744

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-43a78dca-7c46db4744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-43a78dca: serviceaccount "payload-processing-e2e-derive-43a78dca" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-43a78dca-78dd59fb9d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-43a78dca-78dd59fb9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-43a78dca: serviceaccount "payload-processing-e2e-derive-43a78dca" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-43a78dca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-43a78dca-78dd59fb9d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-43a78dca

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-43a78dca: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-43a78dca": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-43a78dca, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 11770918-4071-4559-ae17-b6e16669d0b7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-43a78dca-78dd59fb9d-8pqq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-43a78dca-7c46db4744-8kmc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-43a78dca-openshift-default-665c4ff596-m99jg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-2f0c212d-openshift-default-5db5897fb8

SuccessfulCreate

Created pod: e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

openshift-ingress

deployment-controller

e2e-mt-2f0c212d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2f0c212d-openshift-default-5db5897fb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-2f0c212d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2f0c212d

openshift-ingress

multus

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2f0c212d-847c87d778

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2f0c212d-847c87d778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2f0c212d: serviceaccount "payload-processing-e2e-mt-2f0c212d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2f0c212d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2f0c212d-847c87d778 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2f0c212d: serviceaccount "payload-processing-e2e-mt-2f0c212d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2f0c212d-847c87d778

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2f0c212d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2f0c212d-7559fd6ccb-96ntq

Unhealthy

Readiness probe failed: dial tcp 10.132.0.42:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-2f0c212d-847c87d778-x5h54

Unhealthy

Readiness probe failed: dial tcp 10.132.0.43:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2f0c212d-openshift-default-5db5897fb8-c2kx9

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-59f3c9c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-59f3c9c8

openshift-ingress

replicaset-controller

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4

SuccessfulCreate

Created pod: e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

openshift-ingress

deployment-controller

e2e-mt-59f3c9c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-59f3c9c8-openshift-default-5c9478fbd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-59f3c9c8-77755bc786

SuccessfulCreate

Created pod: payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-59f3c9c8: serviceaccount "payload-processing-e2e-mt-59f3c9c8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-59f3c9c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-59f3c9c8-77755bc786 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-59f3c9c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-59f3c9c8-77755bc786

FailedCreate

Error creating: pods "payload-processing-e2e-mt-59f3c9c8-77755bc786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-59f3c9c8: serviceaccount "payload-processing-e2e-mt-59f3c9c8" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-59f3c9c8-6786cc67bd-ltzz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-59f3c9c8-77755bc786-s82m7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-59f3c9c8-openshift-default-5c9478fbd4-clhs7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-91f5f5-openshift-default-6f9b875854

SuccessfulCreate

Created pod: e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

openshift-ingress

gateway_labeler_controller

e2e-inf-a-91f5f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-91f5f5

openshift-ingress

deployment-controller

e2e-inf-a-91f5f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-91f5f5-openshift-default-6f9b875854 from 0 to 1

openshift-ingress

multus

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-91f5f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-91f5f5-6f65678bbb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-91f5f5-6f65678bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-91f5f5: serviceaccount "payload-processing-e2e-inf-a-91f5f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-91f5f5-6f65678bbb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-91f5f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-91f5f5-6f65678bbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-91f5f5: serviceaccount "payload-processing-e2e-inf-a-91f5f5" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-77907c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-77907c-openshift-default-844869fd78 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-77907c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-77907c

openshift-ingress

replicaset-controller

e2e-inf-b-77907c-openshift-default-844869fd78

SuccessfulCreate

Created pod: e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

openshift-ingress

multus

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-77907c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-77907c-799c76bf6b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-77907c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-77907c-779f5d56fb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-77907c: serviceaccount "payload-processing-e2e-inf-b-77907c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-77907c-799c76bf6b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-77907c-799c76bf6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-77907c: serviceaccount "payload-processing-e2e-inf-b-77907c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-77907c-799c76bf6b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

openshift-ingress

kubelet

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:49464->10.132.0.50:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": read tcp 10.132.0.2:49464->10.132.0.50:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-91f5f5-9df4555b4-x7zbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-91f5f5-6f65678bbb-fcdnh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-91f5f5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-91f5f5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-91f5f5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-91f5f5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e3e5bdbb-7aa9-419a-a569-dfc4290d25d9, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-91f5f5-openshift-default-6f9b875854-rzzfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-77907c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-77907c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-77907c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-77907c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 03e86dfd-4098-4453-911c-b4d78c21bb43, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-77907c-779f5d56fb-gqn2v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-77907c-799c76bf6b-mjwl7

Killing

Stopping container payload-processing

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-c028db

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-c028db-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-c028db-authn-ssl" already exists

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-c028db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c028db-openshift-default-5479dcb646 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-c028db-openshift-default-5479dcb646

SuccessfulCreate

Created pod: e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

openshift-ingress

gateway_labeler_controller

e2e-api-a-c028db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c028db

openshift-ingress

multus

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c028db-d79557994

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c028db-d79557994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c028db: serviceaccount "payload-processing-e2e-api-a-c028db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c028db-d79557994

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c028db-d79557994-p8pvp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c028db-66bc6cff48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c028db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c028db-66bc6cff48 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c028db-66bc6cff48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c028db-66bc6cff48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c028db: serviceaccount "payload-processing-e2e-api-a-c028db" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c028db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c028db-d79557994 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-77907c-openshift-default-844869fd78-fk7qj

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-7afb35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7afb35-openshift-default-5d9cb68c4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-7afb35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7afb35

openshift-ingress

replicaset-controller

e2e-api-b-7afb35-openshift-default-5d9cb68c4b

SuccessfulCreate

Created pod: e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7afb35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7afb35-5cdbf6dc54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7afb35-5cdbf6dc54

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7afb35-5cdbf6dc54

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7afb35-5cdbf6dc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7afb35: serviceaccount "payload-processing-e2e-api-b-7afb35" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7afb35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7afb35-55c645dfb4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7afb35: serviceaccount "payload-processing-e2e-api-b-7afb35" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:48630->10.134.0.66:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:48630->10.134.0.66:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Unhealthy

Readiness probe failed: dial tcp 10.132.0.53:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-c028db-d79557994-p8pvp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c028db-66bc6cff48-8f4xw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-c028db-openshift-default-5479dcb646-t2j95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-7afb35-5cdbf6dc54-w2t7x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7afb35-55c645dfb4-wnhp6

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-1d2c46-openshift-default-78c5c64956

SuccessfulCreate

Created pod: e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

openshift-ingress

deployment-controller

e2e-shared-a-1d2c46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-1d2c46-openshift-default-78c5c64956 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-1d2c46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-1d2c46

openshift-ingress

kubelet

e2e-api-b-7afb35-openshift-default-5d9cb68c4b-smnf6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-1d2c46-545c49ccbb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-1d2c46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-1d2c46-545c49ccbb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-1d2c46-545c49ccbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-1d2c46: serviceaccount "payload-processing-e2e-shared-a-1d2c46" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-1d2c46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-1d2c46-545c49ccbb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-1d2c46: serviceaccount "payload-processing-e2e-shared-a-1d2c46" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

openshift-ingress

kubelet

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8

SuccessfulCreate

Created pod: e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

openshift-ingress

gateway_labeler_controller

e2e-shared-b-1a00f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-1a00f6

openshift-ingress

deployment-controller

e2e-shared-b-1a00f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1a00f6-57c547d686

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-1a00f6-57c547d686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1a00f6: serviceaccount "payload-processing-e2e-shared-b-1a00f6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1a00f6: serviceaccount "payload-processing-e2e-shared-b-1a00f6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-1a00f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-1a00f6-57c547d686 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1a00f6-57c547d686

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-1a00f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-f3a5e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f3a5e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f3a5e8

openshift-ingress

multus

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66

SuccessfulCreate

Created pod: e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f3a5e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8: serviceaccount "payload-processing-e2e-ipp-a-f3a5e8" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f3a5e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f3a5e8: serviceaccount "payload-processing-e2e-ipp-a-f3a5e8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f18332

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f18332

openshift-ingress

multus

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-f18332-openshift-default-7b4578b658

SuccessfulCreate

Created pod: e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

openshift-ingress

deployment-controller

e2e-ipp-b-f18332-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f18332-openshift-default-7b4578b658 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f18332: serviceaccount "payload-processing-e2e-ipp-b-f18332" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f18332

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f18332-659cd5d9c8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f18332-659cd5d9c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f18332-659cd5d9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f18332: serviceaccount "payload-processing-e2e-ipp-b-f18332" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f18332-659cd5d9c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f18332

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-249eef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-249eef

openshift-ingress

deployment-controller

e2e-ipp-cleanup-249eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-249eef-openshift-default-5f45875494 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-249eef-openshift-default-5f45875494

SuccessfulCreate

Created pod: e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-249eef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef: serviceaccount "payload-processing-e2e-ipp-cleanup-249eef" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-249eef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-249eef: serviceaccount "payload-processing-e2e-ipp-cleanup-249eef" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-249eef-7dd794748d-6bv5w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-249eef-56d5b7dbb-kbtxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-249eef-openshift-default-5f45875494-cshbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f3a5e8-6dbf8b48cb-mmd2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f3a5e8-7b9df49d66-dldt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f3a5e8-openshift-default-7476b5dc66-xm4mb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f18332-659cd5d9c8-v7hj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f18332-5cdc7c7bfb-kmlxk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-f18332

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-f18332": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-f18332, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dbf05999-c56e-40d4-9714-46468682add3, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-f18332-openshift-default-7b4578b658-hfc8f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-1d2c46-7f89ff75cb-j6rgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-1d2c46-545c49ccbb-zpzqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-1d2c46-openshift-default-78c5c64956-fvsjd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1a00f6-57c547d686-bwrwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1a00f6-7d975c47d4-45tmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-1a00f6-openshift-default-5f8f9dbcd8-s7xz9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503