Time Namespace Component RelatedObject Reason Message

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pw9s8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pw9s8 to ip-10-0-135-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl to ip-10-0-135-46.ec2.internal

openshift-ingress

kube-auth-proxy-b474cb6fc-kb2gj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b474cb6fc-kb2gj to ip-10-0-143-10.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bdqhq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bdqhq to ip-10-0-129-241.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc to ip-10-0-129-241.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6284q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6284q to ip-10-0-129-241.ec2.internal

openshift-ingress

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7 to ip-10-0-143-10.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-4v2jh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-4v2jh to ip-10-0-143-10.ec2.internal

openshift-ingress

kube-auth-proxy-b474cb6fc-b764w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b474cb6fc-b764w to ip-10-0-129-241.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2 to ip-10-0-143-10.ec2.internal

openshift-ingress

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx to ip-10-0-129-241.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr to ip-10-0-143-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r to ip-10-0-143-10.ec2.internal

openshift-ingress

router-default-69f7b748fb-vt9zm

Scheduled

Successfully assigned openshift-ingress/router-default-69f7b748fb-vt9zm to ip-10-0-129-241.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-gj8d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-gj8d6 to ip-10-0-129-241.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-69f7b748fb from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x11)

openshift-ingress

replicaset-controller

router-default-69f7b748fb

FailedCreate

Error creating: pods "router-default-69f7b748fb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-69f7b748fb

FailedCreate

Error creating: pods "router-default-69f7b748fb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-69f7b748fb

SuccessfulCreate

Created pod: router-default-69f7b748fb-vt9zm
(x6)

openshift-ingress

kubelet

router-default-69f7b748fb-vt9zm

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-69f7b748fb-vt9zm

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-69f7b748fb-vt9zm

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-69f7b748fb-vt9zm

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

kubelet

router-default-69f7b748fb-vt9zm

Created

Created container: router

openshift-ingress

kubelet

router-default-69f7b748fb-vt9zm

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-b474cb6fc from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-b474cb6fc

FailedCreate

Error creating: pods "kube-auth-proxy-b474cb6fc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-b474cb6fc

SuccessfulCreate

Created pod: kube-auth-proxy-b474cb6fc-kb2gj

openshift-ingress

multus

kube-auth-proxy-b474cb6fc-kb2gj

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-b474cb6fc

SuccessfulCreate

Created pod: kube-auth-proxy-b474cb6fc-b764w

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-kb2gj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-b764w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-b474cb6fc-b764w

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bdqhq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-kb2gj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-kb2gj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-kb2gj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.874s (2.874s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bdqhq

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-b764w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.938s (4.938s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-b764w

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b474cb6fc-b764w

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.292s (3.292s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pw9s8

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pw9s8

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

ovnk-controlplane

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

ErrorUpdatingResource

addLogicalPort failed for openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc: failed to update pod openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc: the server rejected our request due to an error in our request

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.008s (3.008s including waiting). Image size: 181126104 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nh8gc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.974s (2.974s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pw9s8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bdqhq

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bdqhq
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6284q

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6284q

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-4v2jh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-gj8d6

openshift-ingress

multus

payload-processing-5cc6cd444b-gj8d6

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-gj8d6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-4v2jh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-4v2jh

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-gj8d6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-4v2jh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.595s (2.596s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-4v2jh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-4v2jh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-gj8d6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.625s (2.625s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-gj8d6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6284q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6284q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6284q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6284q

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6284q

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-9bae9cd1-openshift-default-7c69765744

SuccessfulCreate

Created pod: e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

openshift-ingress

gateway_labeler_controller

e2e-ait-9bae9cd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9bae9cd1

openshift-ingress

deployment-controller

e2e-ait-9bae9cd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9bae9cd1-openshift-default-7c69765744 from 0 to 1

openshift-ingress

multus

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9bae9cd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9bae9cd1-5d5d968544 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9bae9cd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9bae9cd1-5d5d968544

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9bae9cd1-5d5d968544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9bae9cd1: serviceaccount "payload-processing-e2e-ait-9bae9cd1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9bae9cd1-5d5d968544

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9bae9cd1: serviceaccount "payload-processing-e2e-ait-9bae9cd1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

openshift-ingress

kubelet

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:47690->10.134.0.54:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:47690->10.134.0.54:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-9bae9cd1-5d5d968544-c2lrr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9bae9cd1-648c76cbd4-9mt2r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9bae9cd1-openshift-default-7c69765744-f25vx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-migrate-77db2435-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-77db2435-gw

openshift-ingress

deployment-controller

e2e-migrate-77db2435-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-77db2435-gw-openshift-default-768fcdd964 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-77db2435-gw-openshift-default-768fcdd964

SuccessfulCreate

Created pod: e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

openshift-ingress

multus

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.87s (2.87s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-77db2435-6756d98c96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-77db2435

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-77db2435-7b4f7944f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-77db2435-6756d98c96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-77db2435-6756d98c96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-77db2435: serviceaccount "payload-processing-e2e-migrate-77db2435" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-77db2435

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-77db2435-6756d98c96 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-77db2435-7b4f7944f7

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-77db2435-7b4f7944f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-77db2435: serviceaccount "payload-processing-e2e-migrate-77db2435" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-77db2435-7b4f7944f7

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

openshift-ingress

multus

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.716s (1.716s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-77db2435-6756d98c96-6lxfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-77db2435-7b4f7944f7-25pp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-77db2435-gw-openshift-default-768fcdd964-xb6l7

Killing

Stopping container istio-proxy