Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4454b7-openshift-default-5fb7686554-pldch to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z to ip-10-0-141-186.ec2.internal

openshift-ingress

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Scheduled

Successfully assigned openshift-ingress/e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9 to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv to ip-10-0-141-186.ec2.internal

openshift-ingress

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9 to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx to ip-10-0-141-186.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-rbmhd to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k to ip-10-0-136-202.ec2.internal

openshift-ingress

kube-auth-proxy-79b7fd47cd-cgvr7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79b7fd47cd-cgvr7 to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2rh5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2rh5c to ip-10-0-136-202.ec2.internal

openshift-ingress

kube-auth-proxy-79b7fd47cd-9h88c

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-79b7fd47cd-9h88c to ip-10-0-141-186.ec2.internal

openshift-ingress

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

Scheduled

Successfully assigned openshift-ingress/e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2 to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn to ip-10-0-141-186.ec2.internal

openshift-ingress

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4 to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr to ip-10-0-136-202.ec2.internal

openshift-ingress

router-default-59ccbd4756-2q8pl

Scheduled

Successfully assigned openshift-ingress/router-default-59ccbd4756-2q8pl to ip-10-0-141-186.ec2.internal

openshift-ingress

router-default-59ccbd4756-2q8pl

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9 to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7 to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95 to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-22282287-6df7d8c677-btjmd to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67 to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h to ip-10-0-136-202.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-st2lb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-st2lb to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5 to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2 to ip-10-0-142-253.ec2.internal

openshift-ingress

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g to ip-10-0-142-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fhwjc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fhwjc to ip-10-0-136-202.ec2.internal

openshift-ingress

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v to ip-10-0-142-253.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-scfq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-scfq4 to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5 to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6 to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62 to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv to ip-10-0-141-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6 to ip-10-0-136-202.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc to ip-10-0-136-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7 to ip-10-0-141-186.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-59ccbd4756 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

router-default-59ccbd4756

FailedCreate

Error creating: pods "router-default-59ccbd4756-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-59ccbd4756

FailedCreate

Error creating: pods "router-default-59ccbd4756-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-59ccbd4756

SuccessfulCreate

Created pod: router-default-59ccbd4756-2q8pl
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-59ccbd4756-2q8pl

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-59ccbd4756-2q8pl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-59ccbd4756-2q8pl

Created

Created container: router

openshift-ingress

kubelet

router-default-59ccbd4756-2q8pl

Started

Started container router

openshift-ingress

kubelet

router-default-59ccbd4756-2q8pl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-59ccbd4756-2q8pl

AddedInterface

Add eth0 [10.132.0.6/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-79b7fd47cd from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-79b7fd47cd

FailedCreate

Error creating: pods "kube-auth-proxy-79b7fd47cd-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-79b7fd47cd

SuccessfulCreate

Created pod: kube-auth-proxy-79b7fd47cd-9h88c

openshift-ingress

replicaset-controller

kube-auth-proxy-79b7fd47cd

SuccessfulCreate

Created pod: kube-auth-proxy-79b7fd47cd-cgvr7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-79b7fd47cd-cgvr7

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-st2lb

openshift-ingress

multus

kube-auth-proxy-79b7fd47cd-9h88c

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-9h88c

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-cgvr7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-st2lb

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-9h88c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.767s (2.767s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-9h88c

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-9h88c

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-cgvr7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-cgvr7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.161s (4.161s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-79b7fd47cd-cgvr7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.423s (2.423s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.555s (2.555s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c9j8cc

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fhwjc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fhwjc

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.582s (2.582s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fhwjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

Unhealthy

Readiness probe failed: Get "http://10.132.0.24:8080/ready": dial tcp 10.132.0.24:8080: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-st2lb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-st2lb

ProbeError

Readiness probe error: Get "http://10.132.0.24:8080/ready": dial tcp 10.132.0.24:8080: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-rbmhd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-scfq4
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2rh5c

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2rh5c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2rh5c

openshift-ingress

multus

payload-processing-5b54b7fbb7-scfq4

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-scfq4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2rh5c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-scfq4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.086s (3.086s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-scfq4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-scfq4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2rh5c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2rh5c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.125s (3.125s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

ProbeError

Startup probe error: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-rbmhd

Unhealthy

Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-74eee9-openshift-default-77dcfcc64d

SuccessfulCreate

Created pod: e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

openshift-ingress

deployment-controller

e2e-inf-a-74eee9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-74eee9-openshift-default-77dcfcc64d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-74eee9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-74eee9

openshift-ingress

gateway_labeler_controller

e2e-ait-3b43a1da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3b43a1da

openshift-ingress

gateway_labeler_controller

e2e-autores-4454b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4454b7

openshift-ingress

deployment-controller

e2e-ait-3b43a1da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3b43a1da-openshift-default-5997ffb4b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3b43a1da-openshift-default-5997ffb4b6

SuccessfulCreate

Created pod: e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

openshift-ingress

kubelet

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

Started

Started container istio-proxy

openshift-ingress

multus

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-autores-4454b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4454b7-openshift-default-5fb7686554 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-4454b7-openshift-default-5fb7686554

SuccessfulCreate

Created pod: e2e-autores-4454b7-openshift-default-5fb7686554-pldch

openshift-ingress

kubelet

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.045s (3.045s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-3b43a1da-openshift-default-5997ffb4b6-t8dm9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-4454b7-openshift-default-5fb7686554-pldch

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-bae22d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-bae22d

openshift-ingress

deployment-controller

e2e-explicit-bae22d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-bae22d-openshift-default-84785dc564 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-bae22d-openshift-default-84785dc564

SuccessfulCreate

Created pod: e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

openshift-ingress

deployment-controller

e2e-migrate-fbdf5841-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fbdf5841-gw-openshift-default-674969c764 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-fbdf5841-gw-openshift-default-674969c764

SuccessfulCreate

Created pod: e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

openshift-ingress

gateway_labeler_controller

e2e-migrate-fbdf5841-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fbdf5841-gw

openshift-ingress

kubelet

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

Started

Started container istio-proxy

openshift-ingress

multus

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-fbdf5841-gw-openshift-default-dockercfg-h98x6); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-f7fc2b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f7fc2b9f-openshift-default-99c565b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f7fc2b9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f7fc2b9f

openshift-ingress

replicaset-controller

e2e-ait-f7fc2b9f-openshift-default-99c565b6

SuccessfulCreate

Created pod: e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

openshift-ingress

kubelet

e2e-migrate-fbdf5841-gw-openshift-default-674969c764-ss22v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-explicit-bae22d-openshift-default-dockercfg-2k9gn); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-bae22d-openshift-default-84785dc564-r5w9n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.461s (2.461s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-f7fc2b9f-openshift-default-dockercfg-mvfjg); attempting to pull the image may not succeed.

openshift-ingress

replicaset-controller

e2e-derive-79e15b7c-openshift-default-7d4f64d5b

SuccessfulCreate

Created pod: e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

openshift-ingress

deployment-controller

e2e-derive-79e15b7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-79e15b7c-openshift-default-7d4f64d5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-79e15b7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-79e15b7c

openshift-ingress

kubelet

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-f7fc2b9f-openshift-default-99c565b6-gkgpm

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-bd601b-openshift-default-67cbf44b94

SuccessfulCreate

Created pod: e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

openshift-ingress

gateway_labeler_controller

e2e-noten-bd601b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-bd601b

openshift-ingress

deployment-controller

e2e-noten-bd601b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-bd601b-openshift-default-67cbf44b94 from 0 to 1

openshift-ingress

multus

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-79e15b7c-openshift-default-7d4f64d5b-vhjfv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-74eee9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-74eee9-798d95f9bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-74eee9-798d95f9bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-74eee9-798d95f9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-74eee9: serviceaccount "payload-processing-e2e-inf-a-74eee9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-74eee9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-74eee9: serviceaccount "payload-processing-e2e-inf-a-74eee9" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-74eee9-798d95f9bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

openshift-ingress

kubelet

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.329s (2.329s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-ff661a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ff661a-openshift-default-66fc9c6756 from 0 to 1

openshift-ingress

multus

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ff661a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ff661a

openshift-ingress

replicaset-controller

e2e-inf-b-ff661a-openshift-default-66fc9c6756

SuccessfulCreate

Created pod: e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ff661a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ff661a: serviceaccount "payload-processing-e2e-inf-b-ff661a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ff661a-744847d799

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ff661a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ff661a-744847d799 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ff661a-744847d799

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ff661a-744847d799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ff661a: serviceaccount "payload-processing-e2e-inf-b-ff661a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-bd601b-openshift-default-67cbf44b94-xkmcv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-22282287

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-22282287

openshift-ingress

deployment-controller

e2e-mt-22282287-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-22282287-openshift-default-7f4865bc48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-22282287-openshift-default-7f4865bc48

SuccessfulCreate

Created pod: e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

openshift-ingress

multus

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-22282287-86b8764c58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-22282287-86b8764c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-22282287: serviceaccount "payload-processing-e2e-mt-22282287" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-22282287

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-22282287-6df7d8c677 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-22282287-6df7d8c677

SuccessfulCreate

Created pod: payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-22282287

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-22282287-86b8764c58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-22282287-6df7d8c677

FailedCreate

Error creating: pods "payload-processing-e2e-mt-22282287-6df7d8c677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-22282287: serviceaccount "payload-processing-e2e-mt-22282287" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-22282287-86b8764c58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-22282287-86b8764c58-mqhhv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-22282287-6df7d8c677-btjmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-22282287-openshift-default-7f4865bc48-hxl2m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5fb994

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5fb994

openshift-ingress

deployment-controller

e2e-shared-a-w2-5fb994-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5fb994-openshift-default-9648ff944 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5fb994-openshift-default-9648ff944

SuccessfulCreate

Created pod: e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

openshift-ingress

multus

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5fb994

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5fb994-767b59d97f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5fb994: serviceaccount "payload-processing-e2e-shared-a-w2-5fb994" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5fb994: serviceaccount "payload-processing-e2e-shared-a-w2-5fb994" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5fb994

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-74eee9-55b5557bb6-52dfr

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-inf-a-74eee9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-inf-a-74eee9: Operation cannot be fulfilled on endpoints "payload-processing-e2e-inf-a-74eee9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-inf-a-74eee9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d84448e-ae43-4604-89ad-67029a7cc496, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-74eee9-798d95f9bc-74cqz

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-5899e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5899e8-openshift-default-59f95568dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5899e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5899e8

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd

SuccessfulCreate

Created pod: e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

openshift-ingress

multus

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5899e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5899e8: serviceaccount "payload-processing-e2e-shared-b-w2-5899e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5899e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5899e8: serviceaccount "payload-processing-e2e-shared-b-w2-5899e8" not found

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-74eee9-openshift-default-77dcfcc64d-svz6k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ff661a-78bd8c957d-hmt6h

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-ff661a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-ff661a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-ff661a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-ff661a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ee6aa14e-0bee-4176-8bc2-06ba43406f9b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ff661a-744847d799-5s9ff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-16ad45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-16ad45

openshift-ingress

deployment-controller

e2e-shared-a-w3-16ad45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-16ad45-openshift-default-7595944c94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-16ad45-openshift-default-7595944c94

SuccessfulCreate

Created pod: e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

openshift-ingress

kubelet

e2e-inf-b-ff661a-openshift-default-66fc9c6756-xbnp2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-16ad45: serviceaccount "payload-processing-e2e-shared-a-w3-16ad45" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-16ad45: serviceaccount "payload-processing-e2e-shared-a-w3-16ad45" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-16ad45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-16ad45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-6621560b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6621560b

openshift-ingress

multus

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-6621560b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6621560b-openshift-default-8867fc8d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6621560b-openshift-default-8867fc8d8

SuccessfulCreate

Created pod: e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6621560b-66d77649cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6621560b-66d77649cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6621560b: serviceaccount "payload-processing-e2e-mt-6621560b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6621560b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6621560b-66d77649cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6621560b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6621560b: serviceaccount "payload-processing-e2e-mt-6621560b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6621560b-66d77649cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3f81b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3f81b7

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8

SuccessfulCreate

Created pod: e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

openshift-ingress

multus

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-3f81b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3f81b7: serviceaccount "payload-processing-e2e-shared-b-w3-3f81b7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3f81b7: serviceaccount "payload-processing-e2e-shared-b-w3-3f81b7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3f81b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3f81b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg
(x2)

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-6621560b-66d77649cc-9f9ms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6621560b-7c79d7ddf4-xfz62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-6621560b-openshift-default-8867fc8d8-vrkd9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-550dc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-550dc3

openshift-ingress

deployment-controller

e2e-api-a-550dc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-550dc3-openshift-default-85d57474d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-550dc3-openshift-default-85d57474d

SuccessfulCreate

Created pod: e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

openshift-ingress

multus

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-550dc3-66f8b776bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-550dc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-550dc3-66f8b776bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-550dc3-66f8b776bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-550dc3-66f8b776bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-550dc3: serviceaccount "payload-processing-e2e-api-a-550dc3" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

openshift-ingress

kubelet

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-550dc3: serviceaccount "payload-processing-e2e-api-a-550dc3" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-550dc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-cb65dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-cb65dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cb65dc

openshift-ingress

replicaset-controller

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8

SuccessfulCreate

Created pod: e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

openshift-ingress

multus

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cb65dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cb65dc-55cd7bc8ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cb65dc: serviceaccount "payload-processing-e2e-api-b-cb65dc" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cb65dc: serviceaccount "payload-processing-e2e-api-b-cb65dc" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cb65dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh
(x2)

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-550dc3-688c8fc4c8-74lxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-550dc3-66f8b776bc-t87b5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-550dc3-openshift-default-85d57474d-rgdz7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb65dc-684cfbbdb6-t7ghh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb65dc-55cd7bc8ff-kc9vp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-cb65dc-openshift-default-6d6fd7cdb8-872s2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5fb994-767b59d97f-59l8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5fb994-6cb7f9458b-24dbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-5fb994-openshift-default-9648ff944-qvb9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5899e8-8cd6b6d6-9rnd5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5899e8-7f5ff78cf9-27sln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-5899e8-openshift-default-59f95568dd-8qfg9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b022ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b022ee

openshift-ingress

deployment-controller

e2e-ipp-a-b022ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b022ee-openshift-default-7966dcf58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b022ee-openshift-default-7966dcf58

SuccessfulCreate

Created pod: e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

openshift-ingress

multus

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b022ee: serviceaccount "payload-processing-e2e-ipp-a-b022ee" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b022ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b022ee: serviceaccount "payload-processing-e2e-ipp-a-b022ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b022ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b022ee-5bf9c484fc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:55818->10.132.0.69:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": read tcp 10.132.0.2:55818->10.132.0.69:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-cb5c8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-cb5c8c

openshift-ingress

replicaset-controller

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8

SuccessfulCreate

Created pod: e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

openshift-ingress

deployment-controller

e2e-ipp-b-cb5c8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-cb5c8c-openshift-default-75d86674b8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cb5c8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb5c8c: serviceaccount "payload-processing-e2e-ipp-b-cb5c8c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cb5c8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cb5c8c: serviceaccount "payload-processing-e2e-ipp-b-cb5c8c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58

SuccessfulCreate

Created pod: e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-799b5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-799b5a

openshift-ingress

deployment-controller

e2e-ipp-cleanup-799b5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-799b5a: serviceaccount "payload-processing-e2e-ipp-cleanup-799b5a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-799b5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-799b5a: serviceaccount "payload-processing-e2e-ipp-cleanup-799b5a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-799b5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-799b5a-677d8498db-km7q6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-799b5a-7695648cbf-mw9ts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-799b5a-openshift-default-77cf5c6b58-plsmn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b022ee-5bf9c484fc-6v6jx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-b022ee

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-b022ee: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-b022ee": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-b022ee, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 275cd1f1-e5da-4993-84d4-4233cd1c4b55, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b022ee-5d8947fffd-wtr8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b022ee-openshift-default-7966dcf58-lnww4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cb5c8c-5cf6c4bbb7-lfd67

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cb5c8c-7c9bd6984b-5ttp7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-cb5c8c-openshift-default-75d86674b8-plh9v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-16ad45-66b475df66-sccj6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-16ad45-6dcc655c6f-zhd95

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-16ad45-openshift-default-7595944c94-vgmp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3f81b7-7b7cc79cbc-7x4gg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3f81b7-5fd6c7d778-djs2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3f81b7-openshift-default-6ddc4f48b8-fh26g

Killing

Stopping container istio-proxy